imagining syntax

← schedopt_granularity

fixed_16

done · peak unseen_mismatch 86.6

α schedule

α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25

direction
constant
α range
1.6–1.6
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.150.1 ± 1.249.8 ± 1.950.4 ± 1.7
50 50.5 ± 1.350.2 ± 1.550.1 ± 1.649.4 ± 1.4
75 50.8 ± 1.549.4 ± 1.350.3 ± 1.749.9 ± 1.6
100 51.5 ± 1.949.9 ± 1.550.7 ± 2.049.9 ± 1.2
125 54.2 ± 8.849.8 ± 1.953.0 ± 8.449.1 ± 1.9
150 58.9 ± 14.550.0 ± 6.557.3 ± 14.950.0 ± 6.3
175 67.7 ± 18.752.1 ± 8.066.1 ± 19.051.7 ± 6.6
200 80.4 ± 19.860.1 ± 12.479.8 ± 20.158.1 ± 12.0
225 88.6 ± 19.163.5 ± 17.488.3 ± 19.362.5 ± 17.6
250 91.3 ± 17.968.3 ± 20.491.4 ± 17.567.4 ± 20.0
275 94.6 ± 13.677.5 ± 20.294.0 ± 14.577.0 ± 19.5
300 96.1 ± 13.382.1 ± 19.695.8 ± 13.481.7 ± 18.8
325 96.8 ± 10.781.9 ± 20.196.6 ± 11.281.2 ± 20.3
350 98.1 ± 7.885.7 ± 18.897.6 ± 8.884.7 ± 18.7
375 99.6 ± 1.386.2 ± 22.799.0 ± 2.484.9 ± 22.2
400 99.8 ± 0.487.8 ± 25.299.6 ± 0.786.6 ± 24.7

Downloads