imagining syntax

← schedopt_confirm_v2

burst_16

done · peak unseen_mismatch 95.1

Referenced by

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.7 ×25 α 0.7 ×25 α 3.1429 ×25 α 3.1429 ×25 α 3.1429 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25 α 1.2857 ×25 α 1.2857 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25

direction
mixed
α range
0.7–5.0
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.1 ± 1.550.1 ± 1.550.1 ± 1.750.0 ± 1.6
50 51.6 ± 1.950.1 ± 1.750.2 ± 1.549.9 ± 1.5
75 53.6 ± 3.351.7 ± 2.450.9 ± 2.449.9 ± 1.6
100 56.1 ± 8.051.4 ± 3.253.4 ± 7.450.2 ± 2.7
125 65.4 ± 15.550.9 ± 6.263.4 ± 15.749.8 ± 5.9
150 83.7 ± 17.066.5 ± 14.781.4 ± 18.363.7 ± 14.6
175 93.4 ± 10.384.7 ± 13.191.2 ± 12.181.3 ± 13.8
200 95.7 ± 6.091.6 ± 7.792.7 ± 8.286.9 ± 9.5
225 99.5 ± 4.294.8 ± 10.399.3 ± 4.794.1 ± 10.5
250 99.7 ± 3.591.7 ± 14.899.7 ± 3.991.1 ± 14.8
275 99.9 ± 0.890.3 ± 16.799.9 ± 1.389.7 ± 16.8
300 100.0 ± 0.194.5 ± 12.799.9 ± 0.493.7 ± 12.9
325 99.9 ± 0.196.1 ± 10.499.8 ± 0.495.1 ± 10.3
350 100.0 ± 0.095.1 ± 14.0100.0 ± 0.094.9 ± 13.9
375 100.0 ± 0.193.9 ± 14.3100.0 ± 0.293.3 ± 14.2
400 100.0 ± 0.093.4 ± 16.0100.0 ± 0.092.8 ± 15.6

Downloads