imagining syntax

← schedopt_v4

free-173cb72a

done · peak unseen_mismatch 93.7

α schedule

α 4.636 ×21 α 1.407 ×18 α 4.531 ×27 α 1.203 ×34 α 4.833 ×19 α 1.189 ×15 α 5.0 ×35 α 1.085 ×13 α 4.334 ×19 α 0.7515 ×14 α 5.0 ×59 α 1.362 ×26 α 1.362 ×100

direction
mixed
α range
0.7515–5.0
stages
13

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.362

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 52.9 ± 6.149.5 ± 1.951.6 ± 6.250.3 ± 1.6
110 54.8 ± 7.450.3 ± 3.453.4 ± 7.350.0 ± 3.2
120 57.5 ± 10.151.5 ± 4.855.5 ± 10.150.5 ± 4.5
130 61.6 ± 13.353.2 ± 7.659.6 ± 13.451.4 ± 6.9
140 67.4 ± 16.455.8 ± 9.865.2 ± 16.853.8 ± 9.3
150 73.4 ± 17.461.2 ± 11.670.5 ± 18.457.9 ± 11.3
160 78.3 ± 17.267.4 ± 13.275.0 ± 18.763.5 ± 13.4
170 81.5 ± 16.574.0 ± 14.277.9 ± 18.169.7 ± 14.7
180 84.5 ± 16.275.5 ± 14.081.7 ± 17.871.6 ± 14.8
190 87.9 ± 14.079.4 ± 13.385.1 ± 15.775.3 ± 14.2
200 90.3 ± 11.083.3 ± 12.086.3 ± 13.778.0 ± 13.5
210 92.0 ± 10.583.9 ± 13.188.8 ± 12.579.3 ± 13.5
220 94.3 ± 11.083.8 ± 14.091.8 ± 12.881.1 ± 13.9
230 94.1 ± 10.485.4 ± 13.290.2 ± 13.580.8 ± 13.1
240 91.4 ± 11.985.5 ± 11.386.3 ± 13.579.3 ± 11.1
250 90.1 ± 12.185.0 ± 12.183.8 ± 13.277.7 ± 11.4
260 89.1 ± 11.584.2 ± 10.381.7 ± 12.075.2 ± 8.8
270 88.7 ± 11.485.7 ± 10.380.9 ± 11.777.0 ± 11.1
280 89.0 ± 13.287.7 ± 11.682.3 ± 13.079.6 ± 12.4
290 91.3 ± 15.190.0 ± 13.987.7 ± 13.884.8 ± 13.9
300 91.0 ± 15.788.2 ± 17.786.7 ± 16.683.7 ± 17.0
310 82.0 ± 22.479.3 ± 23.479.1 ± 21.576.2 ± 19.7
320 75.6 ± 21.470.4 ± 24.171.8 ± 19.669.2 ± 21.2
330 77.0 ± 22.173.0 ± 21.874.0 ± 19.971.4 ± 20.9
340 77.3 ± 21.471.6 ± 20.373.3 ± 19.470.0 ± 16.4
350 82.0 ± 17.178.4 ± 18.280.0 ± 16.174.2 ± 16.7
360 88.2 ± 11.481.2 ± 15.486.3 ± 11.178.1 ± 12.0
370 98.6 ± 1.095.5 ± 3.197.2 ± 0.493.7 ± 0.7

Downloads