imagining syntax

← curriculum_v1

anneal_3_0

done · peak unseen_mismatch 90.5

Referenced by

α schedule

α 3.0 ×150 α 2.5714 ×150 α 2.1429 ×150 α 1.7143 ×150 α 1.2857 ×150 α 0.8571 ×150 α 0.4286 ×150 α 0.0 ×150

direction
descending
α range
0.0–3.0
stages
8

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 70.1 ± 16.162.2 ± 12.367.1 ± 15.660.3 ± 10.7
300 97.7 ± 1.996.4 ± 3.194.1 ± 4.690.5 ± 8.3
450 97.0 ± 1.394.7 ± 2.190.6 ± 5.484.5 ± 6.0
600 98.7 ± 0.696.0 ± 2.192.6 ± 2.683.9 ± 7.2
750 99.8 ± 0.298.2 ± 1.496.6 ± 3.088.2 ± 6.2
900 100.0 ± 0.091.3 ± 8.999.7 ± 0.476.8 ± 17.7
1050 100.0 ± 0.027.9 ± 12.699.9 ± 0.124.9 ± 12.4
1200 100.0 ± 0.07.3 ± 5.799.8 ± 0.310.4 ± 7.0

Downloads