imagining syntax

← curriculum_v1

reverse_0_3

done · peak unseen_mismatch 86.9

Referenced by

α schedule

α 0.0 ×150 α 0.4286 ×150 α 0.8571 ×150 α 1.2857 ×150 α 1.7143 ×150 α 2.1429 ×150 α 2.5714 ×150 α 3.0 ×150

direction
ascending
α range
0.0–3.0
stages
8

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 53.2 ± 4.849.9 ± 3.352.7 ± 6.249.1 ± 3.5
300 89.8 ± 20.421.6 ± 17.490.1 ± 19.722.9 ± 18.3
450 95.2 ± 14.328.8 ± 22.795.3 ± 14.029.2 ± 23.1
600 100.0 ± 0.050.1 ± 33.2100.0 ± 0.049.4 ± 32.6
750 100.0 ± 0.053.6 ± 33.9100.0 ± 0.054.0 ± 33.6
900 100.0 ± 0.073.5 ± 28.499.8 ± 0.571.8 ± 27.8
1050 98.9 ± 1.189.5 ± 12.897.8 ± 2.386.9 ± 13.5
1200 96.3 ± 1.692.6 ± 4.392.4 ± 4.685.4 ± 6.2

Downloads