imagining syntax

← schedopt_v4

free-f31c9ee1

done · peak unseen_mismatch 96.6

α schedule

α 4.602 ×27 α 1.389 ×27 α 4.726 ×18 α 1.443 ×20 α 3.924 ×21 α 1.488 ×19 α 4.378 ×15 α 0.6833 ×11 α 4.681 ×26 α 1.047 ×18 α 4.463 ×13 α 1.403 ×46 α 4.329 ×21 α 0.807 ×18 α 0.807 ×100

direction
mixed
α range
0.6833–4.726
stages
15

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.807

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 53.4 ± 3.950.3 ± 2.051.8 ± 3.549.8 ± 1.6
110 55.9 ± 7.051.2 ± 3.353.9 ± 6.749.9 ± 2.5
120 60.3 ± 11.253.1 ± 5.257.7 ± 10.750.9 ± 4.5
130 65.0 ± 15.655.3 ± 9.062.6 ± 15.452.8 ± 8.0
140 69.9 ± 17.159.0 ± 11.166.9 ± 17.355.7 ± 9.9
150 75.4 ± 18.164.4 ± 14.272.4 ± 18.361.3 ± 12.7
160 80.2 ± 18.867.0 ± 15.378.1 ± 19.464.5 ± 14.9
170 84.8 ± 17.071.4 ± 15.382.1 ± 18.768.5 ± 15.4
180 85.6 ± 16.175.5 ± 14.283.1 ± 17.072.3 ± 13.7
190 87.8 ± 15.179.7 ± 14.485.2 ± 16.176.3 ± 14.1
200 90.9 ± 14.581.3 ± 15.389.7 ± 15.479.5 ± 15.0
210 92.1 ± 12.678.0 ± 15.690.7 ± 14.175.6 ± 15.5
220 93.4 ± 10.981.6 ± 14.990.9 ± 13.478.4 ± 14.9
230 95.3 ± 10.182.8 ± 15.293.6 ± 11.680.0 ± 14.8
240 95.1 ± 11.579.0 ± 15.994.2 ± 12.476.7 ± 14.3
250 96.3 ± 9.779.0 ± 14.895.3 ± 11.378.1 ± 13.4
260 96.3 ± 8.077.6 ± 17.895.4 ± 9.676.0 ± 17.1
270 97.1 ± 5.375.6 ± 16.496.5 ± 5.974.7 ± 15.7
280 98.1 ± 2.786.1 ± 11.997.3 ± 3.484.4 ± 10.9
290 97.7 ± 2.786.2 ± 8.797.5 ± 3.084.3 ± 8.4
300 99.7 ± 0.284.3 ± 6.199.6 ± 0.480.5 ± 6.4
310 100.0 ± 0.088.9 ± 3.6100.0 ± 0.086.3 ± 3.6
320 100.0 ± 0.087.4 ± 4.2100.0 ± 0.085.2 ± 4.7
330 100.0 ± 0.082.7 ± 11.3100.0 ± 0.081.4 ± 11.9
340 100.0 ± 0.076.3 ± 13.6100.0 ± 0.073.7 ± 12.2
350 100.0 ± 0.071.8 ± 13.8100.0 ± 0.071.0 ± 12.9
360 100.0 ± 0.064.5 ± 12.3100.0 ± 0.063.9 ± 12.8
370 100.0 ± 0.073.0 ± 18.0100.0 ± 0.072.0 ± 18.5
380 100.0 ± 0.059.5 ± 0.099.9 ± 0.059.6 ± 0.0
390 100.0 ± 0.080.4 ± 0.0100.0 ± 0.076.6 ± 0.0
400 100.0 ± 0.097.0 ± 0.0100.0 ± 0.096.6 ± 0.0

Downloads