imagining syntax

← schedopt_v4

fixed_2.0

done · peak unseen_mismatch 88.0

α schedule

α 2.0 ×400

direction
constant
α range
2.0–2.0
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 52.3 ± 4.250.0 ± 1.151.1 ± 3.750.0 ± 1.6
110 52.9 ± 3.350.2 ± 1.951.5 ± 3.449.9 ± 1.8
120 54.4 ± 9.551.1 ± 4.753.9 ± 9.550.7 ± 4.4
130 54.8 ± 10.852.5 ± 8.254.1 ± 10.851.6 ± 8.0
140 56.9 ± 11.152.2 ± 7.055.6 ± 11.151.2 ± 6.7
150 60.3 ± 12.454.0 ± 11.058.3 ± 12.251.7 ± 10.5
160 63.7 ± 13.054.2 ± 9.161.9 ± 12.352.0 ± 7.3
170 67.6 ± 15.756.4 ± 10.465.7 ± 15.853.8 ± 10.0
180 73.3 ± 17.558.5 ± 13.271.1 ± 17.455.9 ± 12.8
190 80.0 ± 17.862.4 ± 15.477.7 ± 18.359.5 ± 14.6
200 85.5 ± 15.767.5 ± 18.282.8 ± 17.764.9 ± 17.3
210 89.9 ± 14.471.1 ± 18.487.6 ± 16.268.2 ± 17.3
220 91.7 ± 14.672.0 ± 20.089.9 ± 15.169.1 ± 18.8
230 92.3 ± 13.769.8 ± 19.990.0 ± 15.067.2 ± 18.2
240 93.8 ± 12.677.1 ± 20.291.6 ± 14.073.3 ± 19.2
250 94.7 ± 12.577.8 ± 20.693.1 ± 13.274.6 ± 19.1
260 94.6 ± 12.677.0 ± 20.192.8 ± 13.573.7 ± 18.6
270 93.5 ± 13.177.8 ± 17.690.9 ± 13.873.9 ± 16.3
280 94.4 ± 11.184.0 ± 16.992.2 ± 12.380.6 ± 16.0
290 95.5 ± 7.686.5 ± 15.592.6 ± 9.581.5 ± 15.0
300 96.2 ± 5.085.2 ± 9.792.4 ± 7.778.6 ± 8.4
310 98.1 ± 1.784.7 ± 17.396.6 ± 2.881.6 ± 16.1
320 98.8 ± 1.387.0 ± 11.798.1 ± 2.283.8 ± 11.6
330 98.4 ± 1.690.0 ± 7.395.4 ± 4.385.4 ± 8.2
340 98.3 ± 1.795.5 ± 3.994.3 ± 5.788.0 ± 9.2
350 97.2 ± 0.093.7 ± 0.092.1 ± 0.083.2 ± 0.0
360 97.4 ± 0.093.1 ± 0.092.3 ± 0.087.4 ± 0.0
370 97.2 ± 0.094.3 ± 0.090.9 ± 0.084.0 ± 0.0
380 96.0 ± 0.093.3 ± 0.086.9 ± 0.080.7 ± 0.0
390 97.3 ± 0.094.2 ± 0.090.7 ± 0.084.4 ± 0.0
400 97.4 ± 0.094.0 ± 0.090.9 ± 0.082.9 ± 0.0

Downloads