imagining syntax

← schedopt_v4

free-fecc32d7

done · peak unseen_mismatch 95.0

α schedule

α 4.582 ×174 α 0.04871 ×50 α 4.343 ×40 α 0.4149 ×36 α 0.4149 ×100

direction
mixed
α range
0.04871–4.582
stages
5

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.4149

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 62.1 ± 8.757.9 ± 7.554.6 ± 7.152.0 ± 4.2
110 67.1 ± 9.963.2 ± 9.158.0 ± 8.954.5 ± 6.6
120 71.8 ± 9.667.9 ± 8.760.4 ± 9.456.7 ± 6.9
130 76.0 ± 8.172.4 ± 7.362.3 ± 9.258.7 ± 7.1
140 78.6 ± 6.975.3 ± 6.164.2 ± 9.061.1 ± 7.5
150 79.5 ± 5.276.8 ± 4.263.9 ± 7.261.0 ± 5.9
160 80.2 ± 4.377.6 ± 3.664.1 ± 6.961.3 ± 5.8
170 81.0 ± 3.878.4 ± 2.963.9 ± 6.161.4 ± 4.8
180 82.2 ± 4.479.7 ± 3.466.2 ± 6.663.6 ± 5.2
190 86.8 ± 7.283.9 ± 6.977.2 ± 10.473.6 ± 9.1
200 94.9 ± 5.092.6 ± 7.091.7 ± 8.188.3 ± 9.4
210 97.9 ± 3.593.7 ± 10.596.8 ± 5.091.4 ± 12.2
220 99.4 ± 1.179.5 ± 22.599.0 ± 2.278.2 ± 23.1
230 100.0 ± 0.069.4 ± 21.0100.0 ± 0.067.1 ± 22.7
240 99.8 ± 0.277.0 ± 21.499.4 ± 0.674.0 ± 23.8
250 100.0 ± 0.073.8 ± 0.0100.0 ± 0.066.7 ± 0.0
260 100.0 ± 0.089.5 ± 0.0100.0 ± 0.084.1 ± 0.0
270 100.0 ± 0.091.2 ± 0.099.4 ± 0.083.9 ± 0.0
280 100.0 ± 0.094.7 ± 0.0100.0 ± 0.089.6 ± 0.0
290 100.0 ± 0.084.7 ± 0.0100.0 ± 0.080.4 ± 0.0
300 100.0 ± 0.086.3 ± 0.0100.0 ± 0.083.1 ± 0.0
310 100.0 ± 0.097.3 ± 0.0100.0 ± 0.095.0 ± 0.0

Downloads