imagining syntax

← schedopt_design

p01

done · peak unseen_mismatch 50.0

α schedule

α 0.1917 ×25 α 0.2406 ×25 α 0.3064 ×25 α 0.3844 ×25 α 0.4723 ×25 α 0.5689 ×25 α 0.673 ×25 α 0.7841 ×25 α 0.9016 ×25 α 1.0249 ×25 α 1.1538 ×25 α 1.2879 ×25 α 1.4269 ×25 α 1.5706 ×25 α 1.7189 ×25 α 1.8715 ×25

direction
ascending
α range
0.1917–1.8715
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.8715

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.3 ± 1.449.7 ± 1.549.8 ± 1.749.4 ± 1.8
50 50.2 ± 1.750.0 ± 1.450.0 ± 1.450.0 ± 1.7
75 50.5 ± 1.549.3 ± 1.850.3 ± 1.449.0 ± 1.6
100 50.0 ± 2.049.9 ± 1.649.7 ± 1.550.0 ± 1.4
125 51.4 ± 2.149.4 ± 1.550.7 ± 1.849.2 ± 1.8
150 54.2 ± 9.748.4 ± 4.453.6 ± 10.048.1 ± 3.9
175 60.3 ± 17.944.4 ± 9.260.2 ± 17.645.1 ± 9.2
200 64.5 ± 19.939.0 ± 15.264.7 ± 19.939.8 ± 15.7
225 70.9 ± 22.436.5 ± 17.871.1 ± 22.237.3 ± 18.3
250 75.3 ± 23.935.4 ± 18.875.5 ± 23.735.9 ± 18.6
275 80.2 ± 24.234.1 ± 20.579.9 ± 24.634.2 ± 20.4
300 80.8 ± 23.529.7 ± 20.781.2 ± 23.029.8 ± 21.0
325 86.6 ± 19.632.7 ± 17.486.4 ± 20.033.3 ± 17.5
350 90.6 ± 18.531.9 ± 24.690.6 ± 18.532.0 ± 24.8
375 94.7 ± 12.839.9 ± 25.294.7 ± 12.740.2 ± 24.9
400 97.6 ± 10.438.7 ± 27.997.6 ± 9.639.1 ± 27.6

Downloads