imagining syntax

← schedopt_v4

free-6d62b591

done · peak unseen_mismatch 94.0

α schedule

α 3.848 ×15 α 3.258 ×56 α 1.882 ×19 α 4.377 ×73 α 0.1827 ×12 α 1.212 ×47 α 1.359 ×48 α 2.489 ×30 α 2.489 ×100

direction
mixed
α range
0.1827–4.377
stages
9

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.489

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 56.0 ± 6.052.0 ± 2.952.6 ± 5.350.2 ± 2.0
110 59.9 ± 9.055.4 ± 6.255.0 ± 8.251.2 ± 4.1
120 64.7 ± 10.659.2 ± 8.458.5 ± 10.353.2 ± 6.4
130 69.9 ± 11.765.1 ± 10.061.5 ± 11.856.9 ± 8.8
140 74.7 ± 11.070.1 ± 9.565.3 ± 11.260.5 ± 8.5
150 79.1 ± 9.675.0 ± 9.068.7 ± 10.463.7 ± 8.7
160 81.2 ± 8.077.4 ± 7.669.4 ± 9.665.4 ± 7.9
170 83.2 ± 8.679.7 ± 8.473.3 ± 10.868.9 ± 9.1
180 90.0 ± 10.485.9 ± 10.585.3 ± 12.179.9 ± 11.6
190 94.3 ± 9.190.0 ± 10.091.8 ± 11.486.1 ± 11.4
200 95.4 ± 8.090.7 ± 9.193.0 ± 9.986.0 ± 10.8
210 95.6 ± 7.087.3 ± 9.893.5 ± 8.082.8 ± 9.8
220 97.5 ± 4.187.8 ± 12.395.9 ± 6.183.7 ± 11.0
230 98.5 ± 2.188.4 ± 12.997.2 ± 3.184.1 ± 12.5
240 99.2 ± 0.983.6 ± 15.798.6 ± 2.179.5 ± 13.4
250 99.9 ± 0.186.9 ± 16.699.9 ± 0.184.7 ± 15.5
260 99.5 ± 0.667.5 ± 13.699.2 ± 0.867.5 ± 12.9
270 100.0 ± 0.073.7 ± 1.1100.0 ± 0.071.7 ± 2.9
280 100.0 ± 0.074.1 ± 18.1100.0 ± 0.072.2 ± 19.2
290 100.0 ± 0.083.9 ± 0.0100.0 ± 0.082.1 ± 0.0
300 100.0 ± 0.097.5 ± 0.0100.0 ± 0.094.0 ± 0.0

Downloads