imagining syntax

← schedopt_v4

fixed_1.6

done · peak unseen_mismatch 62.9

α schedule

α 1.6 ×400

direction
constant
α range
1.6–1.6
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.4 ± 2.249.8 ± 1.050.3 ± 1.749.9 ± 1.9
110 52.1 ± 2.049.4 ± 1.550.6 ± 1.749.8 ± 1.7
120 51.9 ± 2.949.7 ± 2.151.6 ± 2.349.2 ± 1.3
130 52.0 ± 3.050.0 ± 1.651.7 ± 2.549.5 ± 1.8
140 52.6 ± 3.649.4 ± 2.552.9 ± 4.249.1 ± 1.7
150 54.3 ± 6.948.5 ± 3.854.7 ± 6.948.0 ± 4.0
160 57.5 ± 11.348.9 ± 4.456.8 ± 11.448.6 ± 3.8
170 61.1 ± 15.150.3 ± 7.860.3 ± 15.049.9 ± 7.1
180 64.9 ± 18.049.8 ± 13.864.2 ± 18.048.9 ± 13.3
190 71.7 ± 19.551.3 ± 12.670.0 ± 20.249.8 ± 12.3
200 77.1 ± 20.451.6 ± 13.475.8 ± 21.150.5 ± 13.8
210 80.7 ± 20.952.1 ± 15.580.0 ± 21.250.5 ± 15.5
220 85.4 ± 20.350.4 ± 18.184.5 ± 21.049.2 ± 17.9
230 87.2 ± 19.550.6 ± 22.786.8 ± 19.849.5 ± 22.2
240 89.4 ± 17.151.3 ± 22.189.0 ± 17.550.3 ± 21.5
250 92.1 ± 15.955.2 ± 19.392.1 ± 15.754.0 ± 19.4
260 93.4 ± 15.259.0 ± 18.293.3 ± 15.657.8 ± 18.5
270 93.5 ± 15.354.8 ± 25.793.6 ± 15.054.5 ± 25.2
280 94.1 ± 14.654.1 ± 19.693.7 ± 15.552.5 ± 19.9
290 94.6 ± 13.857.6 ± 20.293.9 ± 15.455.5 ± 20.6
300 95.3 ± 11.857.0 ± 17.194.2 ± 13.655.0 ± 17.2
310 95.7 ± 11.757.4 ± 23.894.7 ± 13.056.5 ± 23.1
320 96.6 ± 10.054.0 ± 28.796.3 ± 10.453.0 ± 28.4
330 98.1 ± 5.561.1 ± 25.697.7 ± 5.959.0 ± 24.5
340 98.9 ± 3.064.1 ± 28.698.5 ± 3.462.9 ± 28.5
350 99.4 ± 1.160.0 ± 21.999.0 ± 1.858.6 ± 21.4
360 99.9 ± 0.148.7 ± 16.6100.0 ± 0.048.0 ± 17.3
370 100.0 ± 0.050.4 ± 13.5100.0 ± 0.050.0 ± 14.7
380 100.0 ± 0.051.1 ± 20.2100.0 ± 0.051.8 ± 20.3
390 100.0 ± 0.055.4 ± 19.5100.0 ± 0.055.1 ± 19.0
400 100.0 ± 0.061.2 ± 26.2100.0 ± 0.059.4 ± 26.3

Downloads