imagining syntax

← schedopt_v4

fixed_1.1

done · peak unseen_mismatch 50.3

α schedule

α 1.1 ×400

direction
constant
α range
1.1–1.1
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.1

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.1 ± 2.549.6 ± 1.350.3 ± 2.450.3 ± 1.8
110 51.6 ± 1.649.5 ± 1.750.9 ± 1.350.0 ± 1.7
120 51.3 ± 2.149.4 ± 1.850.7 ± 2.049.8 ± 1.5
130 51.8 ± 4.249.2 ± 2.851.9 ± 3.849.3 ± 2.3
140 52.4 ± 5.848.6 ± 3.752.4 ± 5.048.8 ± 3.7
150 53.1 ± 8.948.1 ± 5.153.4 ± 8.448.1 ± 5.2
160 54.8 ± 10.947.8 ± 4.954.2 ± 11.047.8 ± 4.9
170 56.7 ± 13.546.4 ± 8.855.8 ± 13.746.7 ± 8.5
180 58.6 ± 16.346.9 ± 7.758.0 ± 16.346.9 ± 7.7
190 60.4 ± 17.445.6 ± 9.559.9 ± 17.745.4 ± 8.9
200 65.1 ± 19.541.1 ± 13.364.4 ± 19.842.0 ± 12.8
210 66.8 ± 20.844.8 ± 10.666.2 ± 21.344.9 ± 10.0
220 70.0 ± 22.440.2 ± 14.869.3 ± 23.140.3 ± 14.3
230 70.8 ± 22.941.1 ± 15.170.2 ± 23.140.8 ± 15.2
240 72.2 ± 22.441.8 ± 14.771.3 ± 23.242.1 ± 14.9
250 73.8 ± 21.938.7 ± 16.673.0 ± 22.438.8 ± 16.4
260 76.6 ± 21.436.0 ± 16.776.0 ± 22.035.2 ± 16.5
270 79.3 ± 22.033.8 ± 16.979.2 ± 21.933.9 ± 17.0
280 82.2 ± 22.734.6 ± 17.382.3 ± 22.534.1 ± 17.3
290 83.4 ± 22.735.2 ± 18.183.7 ± 22.335.1 ± 17.9
300 84.4 ± 21.836.2 ± 15.984.6 ± 21.435.6 ± 15.4
310 87.7 ± 20.234.4 ± 17.087.7 ± 20.034.1 ± 16.5
320 88.9 ± 19.935.4 ± 19.889.0 ± 19.635.1 ± 19.7
330 90.5 ± 18.934.0 ± 19.990.3 ± 19.334.0 ± 19.9
340 91.1 ± 17.932.8 ± 22.390.6 ± 18.832.6 ± 22.3
350 91.4 ± 17.435.2 ± 15.791.3 ± 17.734.3 ± 15.7
360 92.7 ± 15.831.4 ± 15.492.6 ± 16.330.9 ± 15.6
370 95.2 ± 13.735.2 ± 15.494.8 ± 14.534.3 ± 15.3
380 95.5 ± 13.429.7 ± 17.495.5 ± 13.529.7 ± 16.6
390 95.5 ± 13.636.2 ± 19.395.4 ± 13.935.5 ± 19.1
400 95.6 ± 13.232.8 ± 18.795.6 ± 13.332.7 ± 18.6

Downloads