imagining syntax

← schedopt_v4

fixed_1.4

done · peak unseen_mismatch 61.1

α schedule

α 1.4 ×400

direction
constant
α range
1.4–1.4
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.4

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.3 ± 2.050.0 ± 1.350.1 ± 1.850.0 ± 1.7
110 51.7 ± 2.149.7 ± 1.950.9 ± 2.149.8 ± 1.6
120 51.0 ± 1.749.7 ± 1.651.3 ± 2.149.4 ± 1.2
130 52.0 ± 3.549.5 ± 1.451.8 ± 3.849.4 ± 1.9
140 54.0 ± 9.448.5 ± 3.553.9 ± 9.048.9 ± 2.8
150 55.4 ± 10.848.9 ± 2.455.2 ± 10.748.4 ± 2.8
160 57.3 ± 12.648.2 ± 4.556.8 ± 13.048.1 ± 4.5
170 59.9 ± 15.547.0 ± 5.758.9 ± 15.946.9 ± 5.8
180 63.4 ± 18.445.9 ± 8.262.6 ± 18.545.7 ± 9.1
190 67.5 ± 19.847.2 ± 9.966.4 ± 20.146.6 ± 9.5
200 70.4 ± 20.947.5 ± 11.269.6 ± 21.147.4 ± 11.5
210 75.8 ± 21.144.3 ± 13.675.1 ± 21.643.8 ± 13.2
220 81.2 ± 20.444.8 ± 15.680.2 ± 21.344.3 ± 16.1
230 86.0 ± 18.348.8 ± 19.385.4 ± 18.848.0 ± 19.0
240 89.6 ± 17.449.0 ± 18.289.3 ± 17.249.6 ± 18.1
250 92.6 ± 16.149.9 ± 22.592.9 ± 15.650.1 ± 23.2
260 93.9 ± 14.850.8 ± 24.093.7 ± 15.251.1 ± 24.1
270 94.0 ± 15.346.7 ± 24.494.1 ± 15.046.7 ± 23.9
280 94.8 ± 14.251.9 ± 17.894.5 ± 14.751.6 ± 17.4
290 94.6 ± 14.756.1 ± 16.794.7 ± 14.355.8 ± 17.0
300 95.1 ± 13.154.9 ± 21.895.1 ± 13.153.7 ± 21.2
310 95.8 ± 11.553.2 ± 23.195.7 ± 11.952.7 ± 22.4
320 97.5 ± 7.654.8 ± 23.397.2 ± 8.054.5 ± 22.7
330 98.9 ± 2.747.6 ± 19.898.9 ± 2.847.3 ± 19.4
340 99.9 ± 0.352.1 ± 14.999.8 ± 0.551.7 ± 15.0
350 100.0 ± 0.255.0 ± 20.699.9 ± 0.255.0 ± 19.8
360 100.0 ± 0.060.8 ± 21.5100.0 ± 0.061.1 ± 20.9
370 100.0 ± 0.053.5 ± 18.4100.0 ± 0.053.4 ± 18.5
380 100.0 ± 0.051.6 ± 23.4100.0 ± 0.052.1 ± 22.9
390 100.0 ± 0.055.3 ± 18.3100.0 ± 0.054.9 ± 18.6
400 100.0 ± 0.059.2 ± 24.7100.0 ± 0.059.3 ± 23.2

Downloads