imagining syntax

← schedopt_v4

free-2d3dce9e

done · peak unseen_mismatch 83.7

α schedule

α 3.194 ×70 α 1.507 ×64 α 3.123 ×12 α 1.255 ×11 α 3.161 ×24 α 1.634 ×24 α 2.729 ×13 α 0.9098 ×12 α 3.345 ×21 α 0.7192 ×22 α 2.79 ×12 α 1.251 ×15 α 1.251 ×100

direction
mixed
α range
0.7192–3.345
stages
13

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.251

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 53.9 ± 4.550.7 ± 2.351.8 ± 3.849.6 ± 1.7
110 56.2 ± 8.351.1 ± 3.553.7 ± 8.050.0 ± 2.5
120 59.7 ± 12.352.1 ± 4.657.2 ± 12.050.7 ± 3.9
130 64.6 ± 15.354.0 ± 7.361.6 ± 15.252.2 ± 6.5
140 70.1 ± 17.957.4 ± 10.567.4 ± 17.854.7 ± 9.3
150 75.5 ± 17.562.7 ± 12.972.8 ± 17.959.4 ± 11.8
160 81.0 ± 18.067.2 ± 15.278.6 ± 18.664.6 ± 14.2
170 85.3 ± 16.473.8 ± 15.082.7 ± 17.470.5 ± 14.3
180 88.4 ± 14.079.7 ± 14.485.6 ± 15.075.9 ± 14.3
190 90.6 ± 13.281.1 ± 14.388.5 ± 13.677.2 ± 13.9
200 92.9 ± 12.384.1 ± 13.891.0 ± 13.180.6 ± 13.4
210 94.0 ± 12.584.1 ± 14.092.1 ± 13.480.2 ± 13.2
220 93.5 ± 13.386.3 ± 13.691.3 ± 13.982.3 ± 13.3
230 93.7 ± 13.683.4 ± 15.092.7 ± 14.080.2 ± 14.9
240 93.3 ± 13.781.4 ± 17.392.4 ± 14.379.6 ± 16.8
250 91.9 ± 14.983.7 ± 13.890.2 ± 15.380.6 ± 12.7
260 93.0 ± 14.080.2 ± 15.191.1 ± 15.278.0 ± 13.7
270 93.1 ± 17.181.8 ± 15.593.3 ± 15.979.7 ± 14.1
280 90.3 ± 19.476.3 ± 17.090.6 ± 18.875.7 ± 15.4
290 89.0 ± 19.079.9 ± 18.389.0 ± 19.078.8 ± 16.0
300 88.3 ± 16.582.1 ± 18.186.3 ± 19.379.8 ± 19.1
310 85.2 ± 14.874.1 ± 16.482.0 ± 17.973.2 ± 17.8
320 81.3 ± 0.066.7 ± 0.077.4 ± 0.060.4 ± 0.0
330 97.2 ± 0.069.4 ± 0.097.3 ± 0.064.5 ± 0.0
340 100.0 ± 0.067.8 ± 0.099.6 ± 0.067.0 ± 0.0
350 100.0 ± 0.083.7 ± 0.0100.0 ± 0.083.7 ± 0.0
360 100.0 ± 0.060.9 ± 0.0100.0 ± 0.060.4 ± 0.0
370 100.0 ± 0.054.1 ± 0.0100.0 ± 0.055.4 ± 0.0
380 100.0 ± 0.075.0 ± 0.0100.0 ± 0.073.5 ± 0.0
390 100.0 ± 0.077.8 ± 0.0100.0 ± 0.077.7 ± 0.0
400 100.0 ± 0.082.5 ± 0.099.9 ± 0.083.6 ± 0.0

Downloads