imagining syntax

← schedopt_v4

fixed_1.2

done · peak unseen_mismatch 50.1

α schedule

α 1.2 ×400

direction
constant
α range
1.2–1.2
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.2

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.3 ± 1.950.0 ± 1.250.1 ± 1.650.1 ± 1.7
110 51.6 ± 1.549.2 ± 1.650.7 ± 2.049.7 ± 1.7
120 51.1 ± 2.349.4 ± 2.151.3 ± 2.249.4 ± 1.7
130 51.1 ± 1.749.4 ± 1.751.4 ± 1.449.6 ± 1.6
140 52.0 ± 3.248.6 ± 2.251.6 ± 2.449.2 ± 2.3
150 53.6 ± 7.447.9 ± 4.153.8 ± 6.847.5 ± 4.9
160 55.6 ± 10.346.2 ± 8.555.3 ± 10.546.3 ± 8.2
170 58.5 ± 11.645.3 ± 9.657.5 ± 11.945.1 ± 9.6
180 64.0 ± 16.843.3 ± 9.963.1 ± 16.942.8 ± 10.8
190 69.1 ± 20.241.4 ± 11.668.2 ± 20.641.0 ± 11.7
200 72.5 ± 23.238.0 ± 13.872.3 ± 23.737.5 ± 14.3
210 74.7 ± 23.233.1 ± 17.374.5 ± 23.433.3 ± 17.4
220 77.6 ± 21.935.5 ± 18.776.8 ± 22.735.3 ± 19.4
230 79.2 ± 22.335.9 ± 18.978.6 ± 23.235.6 ± 19.1
240 81.6 ± 22.333.5 ± 17.381.0 ± 23.133.8 ± 18.0
250 82.3 ± 21.934.0 ± 18.781.9 ± 22.333.6 ± 18.7
260 83.6 ± 21.036.2 ± 17.783.1 ± 21.235.4 ± 17.7
270 85.8 ± 19.831.9 ± 18.786.2 ± 19.331.8 ± 18.3
280 89.8 ± 17.533.6 ± 16.889.5 ± 17.733.6 ± 17.0
290 91.7 ± 17.133.9 ± 19.991.7 ± 16.833.6 ± 19.9
300 93.1 ± 16.233.5 ± 19.893.4 ± 15.632.7 ± 19.0
310 93.7 ± 15.133.6 ± 20.593.7 ± 15.033.4 ± 20.6
320 95.0 ± 13.035.0 ± 21.194.6 ± 13.735.0 ± 21.2
330 96.4 ± 9.937.0 ± 23.696.1 ± 10.836.5 ± 23.0
340 98.8 ± 3.537.3 ± 25.698.8 ± 3.537.0 ± 24.4
350 99.9 ± 0.431.0 ± 16.999.9 ± 0.430.7 ± 17.1
360 100.0 ± 0.036.5 ± 18.8100.0 ± 0.036.3 ± 18.8
370 100.0 ± 0.144.5 ± 16.4100.0 ± 0.045.1 ± 16.1
380 100.0 ± 0.047.0 ± 14.3100.0 ± 0.047.6 ± 14.5
390 100.0 ± 0.045.8 ± 16.6100.0 ± 0.045.6 ± 16.5
400 100.0 ± 0.038.6 ± 15.8100.0 ± 0.038.6 ± 15.4

Downloads