imagining syntax

← schedopt_v4

fixed_1.5

done · peak unseen_mismatch 60.6

α schedule

α 1.5 ×400

direction
constant
α range
1.5–1.5
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.5

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 50.9 ± 1.650.1 ± 1.450.0 ± 2.050.0 ± 2.0
110 51.4 ± 1.649.9 ± 1.750.5 ± 1.550.0 ± 1.6
120 51.4 ± 2.049.6 ± 1.751.3 ± 2.549.0 ± 1.5
130 51.4 ± 2.649.7 ± 1.951.4 ± 2.349.4 ± 1.7
140 52.1 ± 3.149.1 ± 2.152.2 ± 2.948.9 ± 2.1
150 54.1 ± 6.848.6 ± 3.154.2 ± 6.948.3 ± 2.6
160 56.1 ± 10.647.6 ± 5.255.4 ± 11.047.5 ± 5.1
170 58.4 ± 13.647.3 ± 7.857.3 ± 13.947.0 ± 7.5
180 63.1 ± 16.045.9 ± 11.862.6 ± 16.045.5 ± 11.6
190 68.3 ± 20.348.3 ± 8.067.3 ± 20.347.0 ± 7.7
200 71.6 ± 21.947.4 ± 13.970.5 ± 22.647.0 ± 14.5
210 74.6 ± 21.946.9 ± 13.673.6 ± 22.646.4 ± 14.0
220 79.4 ± 20.045.6 ± 15.078.4 ± 20.844.9 ± 15.2
230 82.2 ± 20.246.7 ± 16.981.7 ± 20.546.3 ± 16.4
240 87.7 ± 17.144.6 ± 16.987.1 ± 17.444.5 ± 17.1
250 90.6 ± 15.442.8 ± 20.590.3 ± 15.742.7 ± 20.8
260 94.3 ± 11.840.0 ± 24.293.9 ± 12.539.0 ± 24.2
270 96.7 ± 9.039.5 ± 23.996.6 ± 8.939.1 ± 23.3
280 98.7 ± 4.146.1 ± 21.098.7 ± 4.045.7 ± 20.8
290 99.8 ± 0.754.0 ± 23.599.8 ± 0.553.1 ± 23.4
300 100.0 ± 0.053.0 ± 26.7100.0 ± 0.152.2 ± 26.2
310 100.0 ± 0.056.8 ± 24.4100.0 ± 0.155.6 ± 24.2
320 100.0 ± 0.055.2 ± 22.4100.0 ± 0.054.7 ± 22.1
330 100.0 ± 0.053.0 ± 25.3100.0 ± 0.152.2 ± 25.5
340 100.0 ± 0.052.4 ± 22.9100.0 ± 0.052.1 ± 22.6
350 100.0 ± 0.055.5 ± 26.0100.0 ± 0.055.2 ± 25.5
360 100.0 ± 0.160.5 ± 25.599.9 ± 0.360.6 ± 26.1
370 100.0 ± 0.158.8 ± 23.899.9 ± 0.259.0 ± 23.7
380 100.0 ± 0.052.8 ± 28.1100.0 ± 0.053.0 ± 27.6
390 100.0 ± 0.046.1 ± 19.8100.0 ± 0.046.7 ± 19.7
400 100.0 ± 0.049.1 ± 21.8100.0 ± 0.049.8 ± 21.0

Downloads