imagining syntax

← schedopt_v4

free-152ceb4f

done · peak unseen_mismatch 82.8

α schedule

α 2.925 ×35 α 0.7198 ×13 α 3.771 ×91 α 0.03986 ×14 α 4.005 ×14 α 0.0941 ×17 α 3.373 ×67 α 0.3445 ×49 α 0.3445 ×100

direction
mixed
α range
0.03986–4.005
stages
9

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.3445

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 53.0 ± 3.750.6 ± 2.351.3 ± 2.849.5 ± 1.6
110 55.5 ± 6.452.2 ± 4.552.6 ± 5.750.6 ± 3.3
120 59.3 ± 9.254.7 ± 7.055.1 ± 8.551.6 ± 4.9
130 63.8 ± 12.759.1 ± 9.858.7 ± 11.854.5 ± 8.1
140 68.2 ± 14.062.8 ± 11.662.2 ± 13.357.2 ± 9.9
150 69.5 ± 16.663.0 ± 13.665.9 ± 16.559.6 ± 12.3
160 75.6 ± 18.566.9 ± 16.672.9 ± 19.663.9 ± 15.9
170 77.4 ± 17.868.5 ± 16.374.0 ± 18.964.9 ± 15.7
180 80.8 ± 18.569.2 ± 17.579.0 ± 19.066.8 ± 16.7
190 85.5 ± 17.069.4 ± 16.483.8 ± 18.466.6 ± 16.1
200 89.3 ± 14.574.2 ± 16.787.8 ± 15.671.4 ± 16.6
210 91.2 ± 13.478.3 ± 16.389.1 ± 15.274.7 ± 15.9
220 91.9 ± 12.480.3 ± 14.788.9 ± 14.476.0 ± 14.5
230 91.3 ± 12.380.0 ± 14.487.4 ± 15.174.8 ± 15.0
240 91.4 ± 10.182.3 ± 12.686.5 ± 13.575.9 ± 13.1
250 92.7 ± 7.388.3 ± 7.687.0 ± 12.080.9 ± 10.4
260 93.7 ± 7.488.5 ± 9.289.4 ± 10.382.8 ± 10.6
270 95.7 ± 6.383.9 ± 17.593.6 ± 8.281.1 ± 16.9
280 97.8 ± 2.578.3 ± 20.697.6 ± 3.375.7 ± 20.3
290 99.0 ± 1.667.0 ± 23.898.8 ± 2.065.4 ± 23.8
300 100.0 ± 0.060.6 ± 19.8100.0 ± 0.059.5 ± 19.1
310 100.0 ± 0.051.5 ± 35.0100.0 ± 0.051.9 ± 33.8
320 100.0 ± 0.025.9 ± 13.8100.0 ± 0.027.8 ± 13.8
330 100.0 ± 0.028.2 ± 20.9100.0 ± 0.029.0 ± 22.0
340 100.0 ± 0.025.4 ± 23.1100.0 ± 0.025.6 ± 23.8
350 100.0 ± 0.021.1 ± 18.4100.0 ± 0.021.4 ± 19.1
360 100.0 ± 0.03.5 ± 2.9100.0 ± 0.03.0 ± 2.9
370 100.0 ± 0.012.2 ± 11.8100.0 ± 0.011.9 ± 11.2
380 100.0 ± 0.014.8 ± 14.1100.0 ± 0.015.3 ± 14.3
390 100.0 ± 0.018.7 ± 16.6100.0 ± 0.019.0 ± 17.4
400 100.0 ± 0.018.6 ± 1.6100.0 ± 0.018.9 ± 3.0

Downloads