imagining syntax

← schedopt_confirm

cand2

done · peak unseen_mismatch 96.8

α schedule

α 4.2358 ×25 α 4.0116 ×25 α 3.7763 ×25 α 3.5344 ×25 α 3.2878 ×25 α 3.0374 ×25 α 2.7839 ×25 α 2.5278 ×25 α 2.2694 ×25 α 2.009 ×25 α 1.7467 ×25 α 1.4827 ×25 α 1.2172 ×25 α 0.9502 ×25 α 0.682 ×25 α 0.4124 ×25

direction
descending
α range
0.4124–4.2358
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.4124

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.0 ± 1.650.0 ± 1.549.9 ± 1.849.9 ± 1.8
50 51.8 ± 1.950.3 ± 1.650.3 ± 1.849.9 ± 1.7
75 53.2 ± 3.050.9 ± 2.351.0 ± 2.250.0 ± 1.7
100 61.5 ± 8.456.9 ± 6.355.0 ± 6.351.8 ± 4.1
125 75.0 ± 10.570.2 ± 9.564.1 ± 10.859.7 ± 7.9
150 83.0 ± 7.779.7 ± 7.369.7 ± 10.165.7 ± 8.4
175 86.8 ± 5.384.0 ± 5.073.1 ± 8.269.6 ± 7.4
200 89.6 ± 3.687.2 ± 3.275.9 ± 7.372.2 ± 6.6
225 92.1 ± 2.790.1 ± 2.678.7 ± 6.575.2 ± 5.8
250 94.5 ± 2.092.8 ± 2.083.0 ± 5.479.4 ± 4.8
275 96.8 ± 1.295.3 ± 1.387.9 ± 3.983.9 ± 4.2
300 98.5 ± 0.797.2 ± 1.092.4 ± 3.088.3 ± 3.9
325 99.5 ± 0.498.7 ± 0.896.5 ± 2.292.9 ± 3.7
350 99.9 ± 0.199.4 ± 0.799.0 ± 1.096.1 ± 3.6
375 100.0 ± 0.099.2 ± 3.599.8 ± 0.496.8 ± 5.9
400 100.0 ± 0.096.2 ± 9.4100.0 ± 0.192.6 ± 13.0

Downloads