imagining syntax

← curriculum_v1

fixed_14_single

done · peak unseen_mismatch 88.3

Referenced by

α schedule

α 1.4 ×1200

direction
constant
α range
1.4–1.4
stages
1

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.4

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 52.8 ± 3.649.1 ± 1.952.6 ± 3.647.6 ± 3.0
300 84.8 ± 22.645.2 ± 19.584.4 ± 22.945.3 ± 19.0
450 100.0 ± 0.036.1 ± 30.8100.0 ± 0.036.9 ± 30.6
600 100.0 ± 0.069.7 ± 26.0100.0 ± 0.069.8 ± 25.7
750 99.9 ± 0.471.3 ± 29.499.8 ± 0.770.8 ± 28.6
900 99.8 ± 0.380.3 ± 23.399.5 ± 0.977.8 ± 21.7
1050 99.8 ± 0.493.1 ± 7.199.5 ± 0.588.3 ± 7.9
1200 99.7 ± 0.393.3 ± 8.098.4 ± 1.988.2 ± 9.1

Downloads