imagining syntax

← schedopt_v4

free-dcce7e2c

done · peak unseen_mismatch 98.0

α schedule

α 4.486 ×47 α 2.385 ×42 α 4.197 ×31 α 0.4647 ×21 α 0.4635 ×13 α 3.347 ×20 α 2.643 ×34 α 3.413 ×69 α 0.2656 ×23 α 0.2656 ×100

direction
mixed
α range
0.2656–4.486
stages
10

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2656

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 57.4 ± 7.753.6 ± 5.753.1 ± 6.050.6 ± 4.2
110 61.8 ± 8.857.2 ± 7.155.5 ± 7.151.9 ± 5.4
120 67.4 ± 10.462.1 ± 8.659.3 ± 9.154.9 ± 6.7
130 70.1 ± 12.263.5 ± 10.363.7 ± 12.557.9 ± 9.1
140 76.5 ± 15.666.0 ± 12.172.5 ± 16.861.6 ± 11.9
150 83.9 ± 17.665.2 ± 14.481.5 ± 19.062.6 ± 14.2
160 88.9 ± 16.567.3 ± 16.987.4 ± 18.064.8 ± 16.6
170 91.7 ± 14.476.8 ± 16.390.0 ± 16.374.3 ± 15.9
180 92.9 ± 11.882.0 ± 13.690.8 ± 14.378.8 ± 14.5
190 93.6 ± 10.283.6 ± 12.190.7 ± 12.979.8 ± 12.3
200 94.0 ± 8.385.8 ± 11.290.6 ± 11.181.4 ± 11.4
210 94.5 ± 6.689.1 ± 9.490.5 ± 9.484.1 ± 9.7
220 93.5 ± 3.988.3 ± 7.187.6 ± 7.580.8 ± 7.7
230 93.0 ± 3.188.0 ± 6.086.1 ± 7.679.4 ± 6.0
240 92.9 ± 3.689.9 ± 3.785.3 ± 7.280.4 ± 6.9
250 92.1 ± 3.389.2 ± 3.383.4 ± 7.079.1 ± 5.8
260 92.0 ± 2.988.7 ± 2.982.8 ± 7.478.4 ± 5.7
270 91.4 ± 2.988.4 ± 3.080.7 ± 7.276.8 ± 6.3
280 93.2 ± 2.790.6 ± 2.784.2 ± 6.880.6 ± 5.3
290 98.7 ± 1.697.8 ± 2.297.1 ± 3.795.5 ± 4.5
300 99.7 ± 0.198.9 ± 0.898.9 ± 0.098.0 ± 0.6

Downloads