imagining syntax

← schedopt_v4

free-36f2d865

done · peak unseen_mismatch 86.1

α schedule

α 4.193 ×30 α 1.356 ×22 α 4.456 ×36 α 1.8 ×21 α 4.31 ×19 α 0.9352 ×25 α 4.117 ×19 α 1.41 ×50 α 4.477 ×12 α 1.297 ×21 α 4.84 ×13 α 1.68 ×20 α 4.56 ×12 α 4.56 ×100

direction
mixed
α range
0.9352–4.84
stages
14

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.56

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 55.5 ± 5.951.1 ± 2.852.7 ± 5.449.6 ± 2.2
110 58.6 ± 10.152.4 ± 4.955.6 ± 9.350.8 ± 3.6
120 62.8 ± 12.955.9 ± 7.059.3 ± 12.552.7 ± 6.0
130 67.5 ± 14.959.8 ± 9.763.2 ± 14.856.2 ± 8.7
140 71.3 ± 17.362.4 ± 12.667.8 ± 17.658.6 ± 12.1
150 75.7 ± 18.864.2 ± 14.673.7 ± 19.261.4 ± 14.1
160 81.6 ± 18.668.6 ± 17.279.8 ± 19.265.8 ± 16.9
170 83.4 ± 17.873.2 ± 17.081.2 ± 18.470.0 ± 16.2
180 85.6 ± 17.775.3 ± 18.383.4 ± 18.272.1 ± 17.4
190 87.4 ± 17.573.4 ± 18.585.7 ± 18.570.8 ± 17.9
200 90.0 ± 15.674.6 ± 16.488.3 ± 17.372.5 ± 16.2
210 92.6 ± 12.974.7 ± 16.091.1 ± 14.872.5 ± 15.4
220 94.5 ± 11.478.0 ± 15.793.5 ± 12.376.2 ± 15.2
230 95.4 ± 10.880.1 ± 15.694.6 ± 11.078.8 ± 14.9
240 95.1 ± 11.674.5 ± 19.794.1 ± 12.272.6 ± 19.3
250 95.6 ± 11.573.4 ± 24.294.5 ± 12.671.8 ± 24.4
260 95.2 ± 11.766.8 ± 23.094.2 ± 12.665.1 ± 22.4
270 94.8 ± 12.372.1 ± 21.394.0 ± 12.769.8 ± 20.6
280 96.4 ± 8.380.5 ± 16.095.8 ± 9.377.0 ± 15.8
290 97.1 ± 5.577.5 ± 18.296.3 ± 6.975.5 ± 17.8
300 97.5 ± 4.784.2 ± 19.896.2 ± 6.282.0 ± 19.7
310 93.8 ± 6.067.2 ± 17.091.7 ± 8.362.3 ± 13.4
320 96.0 ± 4.070.5 ± 18.492.8 ± 7.265.4 ± 14.7
330 96.0 ± 4.085.2 ± 4.092.5 ± 7.579.8 ± 0.1
340 95.7 ± 4.077.5 ± 13.294.2 ± 5.774.4 ± 11.8
350 95.8 ± 4.280.6 ± 8.092.5 ± 7.575.6 ± 6.8
360 95.9 ± 3.987.0 ± 3.493.0 ± 6.878.7 ± 3.4
370 94.8 ± 5.087.8 ± 1.291.7 ± 7.481.0 ± 2.4
380 96.0 ± 2.891.9 ± 3.092.0 ± 5.586.1 ± 6.4
390 94.2 ± 0.090.5 ± 0.087.6 ± 0.081.8 ± 0.0
400 95.1 ± 0.092.1 ± 0.089.3 ± 0.084.8 ± 0.0

Downloads