imagining syntax

← schedopt_granularity

smooth_16

done · peak unseen_mismatch 98.1

α schedule

α 3.2007 ×25 α 3.1661 ×25 α 3.1038 ×25 α 3.016 ×25 α 2.904 ×25 α 2.7689 ×25 α 2.6113 ×25 α 2.4318 ×25 α 2.2309 ×25 α 2.009 ×25 α 1.7666 ×25 α 1.5038 ×25 α 1.221 ×25 α 0.9185 ×25 α 0.5965 ×25 α 0.2551 ×25

direction
descending
α range
0.2551–3.2007
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2551

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.3 ± 1.250.5 ± 1.249.5 ± 2.050.3 ± 1.6
50 51.4 ± 1.350.2 ± 1.349.9 ± 1.849.5 ± 1.6
75 52.0 ± 1.850.0 ± 1.650.7 ± 2.249.8 ± 1.9
100 57.5 ± 7.753.8 ± 4.053.6 ± 8.050.5 ± 1.8
125 70.2 ± 11.864.9 ± 11.262.0 ± 11.656.8 ± 8.9
150 82.6 ± 10.477.8 ± 10.173.6 ± 13.267.5 ± 11.2
175 89.0 ± 7.986.1 ± 7.979.2 ± 11.974.4 ± 10.9
200 91.4 ± 5.689.0 ± 6.781.2 ± 10.077.7 ± 9.6
225 93.6 ± 3.591.8 ± 3.884.3 ± 8.480.0 ± 8.8
250 95.7 ± 2.094.3 ± 2.387.9 ± 6.084.1 ± 6.5
275 97.2 ± 1.295.7 ± 1.590.8 ± 4.187.0 ± 4.2
300 98.5 ± 0.897.6 ± 1.194.7 ± 2.690.8 ± 3.3
325 99.6 ± 0.399.0 ± 0.697.6 ± 2.094.4 ± 3.4
350 99.9 ± 0.199.6 ± 0.399.3 ± 0.797.0 ± 2.4
375 100.0 ± 0.099.7 ± 0.499.9 ± 0.298.1 ± 2.4
400 100.0 ± 0.090.9 ± 17.7100.0 ± 0.086.4 ± 20.8

Downloads