imagining syntax

← schedopt_v4

fixed_1.7

done · peak unseen_mismatch 98.3

α schedule

α 1.7 ×400

direction
constant
α range
1.7–1.7
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.4 ± 2.449.7 ± 1.150.1 ± 2.050.1 ± 2.0
110 51.5 ± 1.649.8 ± 1.650.6 ± 1.450.0 ± 1.3
120 51.7 ± 2.649.9 ± 1.750.8 ± 1.849.3 ± 1.1
130 51.5 ± 2.249.9 ± 1.251.0 ± 1.349.5 ± 1.5
140 51.7 ± 2.549.6 ± 1.651.5 ± 2.649.4 ± 1.5
150 54.4 ± 6.549.4 ± 3.053.9 ± 5.949.0 ± 2.7
160 57.3 ± 10.948.2 ± 5.356.8 ± 11.048.4 ± 5.3
170 60.9 ± 16.049.8 ± 6.059.9 ± 16.649.3 ± 5.9
180 65.4 ± 17.251.7 ± 6.363.9 ± 17.850.9 ± 5.7
190 69.5 ± 19.052.9 ± 8.268.5 ± 19.351.7 ± 7.7
200 74.5 ± 19.251.3 ± 12.073.9 ± 20.050.9 ± 11.0
210 83.2 ± 17.257.3 ± 14.581.8 ± 18.156.3 ± 13.8
220 88.3 ± 16.260.3 ± 15.987.2 ± 16.659.4 ± 15.6
230 91.2 ± 16.561.0 ± 13.590.7 ± 16.460.5 ± 13.1
240 92.2 ± 16.962.4 ± 15.991.9 ± 17.061.8 ± 15.1
250 93.0 ± 15.564.1 ± 14.392.6 ± 16.162.7 ± 14.2
260 94.0 ± 13.359.7 ± 17.393.5 ± 14.159.3 ± 16.5
270 95.3 ± 11.565.5 ± 13.394.9 ± 12.365.1 ± 13.4
280 96.9 ± 10.272.3 ± 17.496.5 ± 11.870.7 ± 17.5
290 97.2 ± 8.672.6 ± 17.796.5 ± 11.171.0 ± 17.4
300 98.5 ± 4.569.8 ± 13.998.1 ± 5.869.3 ± 13.0
310 99.4 ± 2.073.6 ± 18.499.0 ± 3.172.6 ± 18.0
320 99.5 ± 1.470.6 ± 18.799.5 ± 1.569.5 ± 17.5
330 100.0 ± 0.078.5 ± 14.7100.0 ± 0.077.9 ± 14.1
340 100.0 ± 0.077.8 ± 16.0100.0 ± 0.077.8 ± 14.3
350 100.0 ± 0.081.2 ± 16.0100.0 ± 0.080.8 ± 15.4
360 100.0 ± 0.079.6 ± 21.1100.0 ± 0.077.9 ± 19.8
370 99.9 ± 0.182.0 ± 18.3100.0 ± 0.080.0 ± 16.3
380 100.0 ± 0.086.9 ± 7.7100.0 ± 0.085.1 ± 7.6
390 100.0 ± 0.088.0 ± 0.0100.0 ± 0.086.7 ± 0.0
400 100.0 ± 0.098.8 ± 0.0100.0 ± 0.098.3 ± 0.0

Downloads