imagining syntax

← efficiency_v1

fixed_14

done · peak unseen_mismatch 90.5

Referenced by

α schedule

α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150

direction
constant
α range
1.4–1.4
stages
16

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.4

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 52.8 ± 3.649.1 ± 1.952.6 ± 3.647.6 ± 3.0
300 90.1 ± 19.238.8 ± 20.789.8 ± 19.639.0 ± 20.1
450 100.0 ± 0.046.0 ± 28.5100.0 ± 0.046.8 ± 28.4
600 100.0 ± 0.036.1 ± 28.7100.0 ± 0.037.1 ± 28.5
750 100.0 ± 0.151.6 ± 32.1100.0 ± 0.052.4 ± 31.9
900 100.0 ± 0.174.6 ± 32.699.8 ± 0.572.5 ± 31.1
1050 99.9 ± 0.280.5 ± 26.699.2 ± 1.377.3 ± 25.7
1200 99.8 ± 0.391.5 ± 13.799.4 ± 0.988.6 ± 12.4
1350 99.8 ± 0.291.8 ± 15.199.0 ± 1.687.8 ± 13.5
1500 99.8 ± 0.391.0 ± 13.599.2 ± 1.086.6 ± 12.4
1650 99.8 ± 0.293.7 ± 6.698.8 ± 1.486.4 ± 8.6
1800 99.8 ± 0.297.0 ± 3.198.7 ± 1.490.5 ± 7.2
1950 99.9 ± 0.196.7 ± 3.497.8 ± 2.289.5 ± 7.6
2100 99.8 ± 0.296.1 ± 4.797.4 ± 2.786.0 ± 8.8
2250 99.8 ± 0.396.0 ± 3.196.5 ± 3.083.4 ± 8.5
2400 99.9 ± 0.196.5 ± 3.297.6 ± 1.486.0 ± 6.2

Downloads