imagining syntax

← curriculum_v1

fixed_14_fresh

done · peak unseen_mismatch 88.6

Referenced by

α schedule

α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150 α 1.4 ×150

direction
constant
α range
1.4–1.4
stages
8

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.4

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 52.8 ± 3.649.1 ± 1.952.6 ± 3.647.6 ± 3.0
300 90.1 ± 19.238.8 ± 20.789.8 ± 19.639.0 ± 20.1
450 100.0 ± 0.046.0 ± 28.5100.0 ± 0.046.8 ± 28.4
600 100.0 ± 0.036.1 ± 28.7100.0 ± 0.037.1 ± 28.5
750 100.0 ± 0.151.6 ± 32.1100.0 ± 0.052.4 ± 31.9
900 100.0 ± 0.174.6 ± 32.699.8 ± 0.572.5 ± 31.1
1050 99.9 ± 0.280.5 ± 26.699.2 ± 1.377.3 ± 25.7
1200 99.8 ± 0.391.5 ± 13.799.4 ± 0.988.6 ± 12.4

Downloads