imagining syntax

← schedopt_v4

free-d41b355f

done · peak unseen_mismatch 82.7

α schedule

α 4.217 ×20 α 1.735 ×12 α 4.668 ×24 α 2.304 ×10 α 2.413 ×36 α 1.163 ×22 α 3.003 ×31 α 2.01 ×13 α 0.7634 ×16 α 1.572 ×18 α 2.216 ×28 α 2.395 ×14 α 4.871 ×10 α 3.467 ×46 α 3.467 ×100

direction
mixed
α range
0.7634–4.871
stages
15

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.467

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 55.9 ± 6.651.7 ± 2.853.2 ± 5.950.1 ± 2.1
110 58.3 ± 8.452.6 ± 4.355.4 ± 8.251.0 ± 2.9
120 61.7 ± 12.554.4 ± 7.359.0 ± 12.051.9 ± 6.1
130 68.0 ± 16.456.8 ± 9.565.4 ± 16.754.2 ± 8.2
140 73.7 ± 17.462.9 ± 13.670.2 ± 18.359.1 ± 12.4
150 78.9 ± 17.568.6 ± 14.375.1 ± 18.664.0 ± 13.6
160 82.5 ± 16.673.5 ± 15.078.4 ± 18.368.8 ± 14.6
170 85.8 ± 16.077.4 ± 14.882.1 ± 17.472.6 ± 14.9
180 88.9 ± 15.677.9 ± 15.286.4 ± 17.274.3 ± 15.2
190 91.2 ± 15.874.5 ± 17.189.9 ± 17.271.9 ± 16.4
200 92.4 ± 14.376.4 ± 18.690.6 ± 17.073.6 ± 18.1
210 93.1 ± 13.578.7 ± 16.691.0 ± 15.475.7 ± 16.5
220 93.0 ± 14.181.0 ± 18.391.1 ± 14.978.0 ± 18.0
230 91.0 ± 15.280.2 ± 17.088.7 ± 15.276.2 ± 16.7
240 91.1 ± 14.178.0 ± 16.487.7 ± 15.173.5 ± 14.7
250 92.5 ± 10.285.2 ± 11.587.7 ± 12.578.9 ± 10.7
260 92.3 ± 9.888.9 ± 9.487.0 ± 11.882.7 ± 9.9
270 91.5 ± 7.488.9 ± 7.184.3 ± 9.681.2 ± 6.8
280 93.4 ± 5.089.7 ± 4.686.4 ± 8.781.6 ± 6.4
290 93.2 ± 3.791.1 ± 2.785.0 ± 7.681.4 ± 5.9
300 93.1 ± 2.190.4 ± 2.585.1 ± 5.581.0 ± 4.9
310 92.8 ± 3.390.9 ± 2.583.3 ± 7.980.6 ± 6.4
320 92.5 ± 1.990.4 ± 2.081.6 ± 5.678.3 ± 4.5
330 92.3 ± 1.690.2 ± 2.181.5 ± 5.978.1 ± 5.2
340 92.2 ± 1.490.3 ± 1.579.8 ± 5.377.0 ± 5.2
350 91.5 ± 1.689.4 ± 2.479.0 ± 4.575.9 ± 5.0
360 91.8 ± 1.590.1 ± 2.279.2 ± 4.475.7 ± 4.0
370 91.0 ± 2.089.5 ± 1.477.8 ± 4.874.6 ± 4.0
380 91.2 ± 1.589.7 ± 1.678.1 ± 4.474.8 ± 3.9
390 91.1 ± 1.489.6 ± 2.078.3 ± 4.875.2 ± 4.6
400 90.9 ± 1.489.5 ± 1.677.8 ± 4.373.7 ± 3.2

Downloads