imagining syntax

← schedopt_v4

fixed_1.8

done · peak unseen_mismatch 98.1

α schedule

α 1.8 ×400

direction
constant
α range
1.8–1.8
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.8

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.8 ± 2.449.7 ± 1.250.3 ± 2.049.8 ± 2.0
110 51.6 ± 1.949.5 ± 1.650.4 ± 2.050.0 ± 1.7
120 51.9 ± 2.849.7 ± 1.551.4 ± 2.749.5 ± 1.2
130 52.5 ± 4.050.2 ± 2.051.6 ± 4.049.8 ± 2.0
140 54.5 ± 8.349.8 ± 2.454.0 ± 7.849.9 ± 1.6
150 56.8 ± 10.349.8 ± 4.256.1 ± 9.348.9 ± 3.8
160 60.3 ± 12.850.8 ± 5.258.6 ± 12.850.2 ± 4.4
170 65.4 ± 17.153.2 ± 6.363.4 ± 17.151.7 ± 4.8
180 69.3 ± 19.757.4 ± 10.268.4 ± 20.156.1 ± 9.8
190 72.1 ± 21.458.1 ± 13.170.7 ± 22.356.9 ± 12.6
200 76.7 ± 19.161.7 ± 17.575.1 ± 20.759.9 ± 17.7
210 83.8 ± 16.561.8 ± 15.081.4 ± 17.759.6 ± 14.9
220 87.6 ± 16.769.9 ± 13.486.4 ± 17.668.2 ± 13.9
230 91.5 ± 15.772.1 ± 13.390.1 ± 16.570.2 ± 13.1
240 92.2 ± 15.373.6 ± 15.391.6 ± 15.471.9 ± 15.9
250 91.6 ± 15.872.3 ± 16.990.7 ± 16.070.5 ± 17.0
260 92.6 ± 15.170.2 ± 19.391.6 ± 16.268.1 ± 19.3
270 94.4 ± 11.070.1 ± 22.993.4 ± 12.468.0 ± 22.5
280 97.2 ± 5.076.0 ± 23.696.8 ± 5.274.0 ± 23.5
290 98.8 ± 1.877.3 ± 18.098.6 ± 1.575.8 ± 17.9
300 99.6 ± 0.661.2 ± 14.199.1 ± 1.159.8 ± 13.6
310 99.6 ± 0.364.8 ± 12.299.5 ± 0.762.4 ± 11.3
320 100.0 ± 0.166.7 ± 11.499.7 ± 0.664.9 ± 8.8
330 100.0 ± 0.085.9 ± 14.499.8 ± 0.384.5 ± 13.5
340 100.0 ± 0.089.9 ± 7.0100.0 ± 0.089.1 ± 6.1
350 100.0 ± 0.098.1 ± 1.2100.0 ± 0.098.1 ± 1.0

Downloads