imagining syntax

← schedopt_granularity

burst_48

done · peak unseen_mismatch 90.1

α schedule

α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 5.0 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 0.7 ×9 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 3.1429 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 1.2857 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8 α 0.7 ×8

direction
mixed
α range
0.7–5.0
stages
48

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.4 ± 1.749.9 ± 1.549.7 ± 1.549.7 ± 1.6
50 52.0 ± 1.850.5 ± 1.950.1 ± 1.749.7 ± 1.5
75 53.1 ± 3.351.5 ± 2.351.0 ± 1.649.6 ± 1.5
100 55.1 ± 5.450.9 ± 1.952.9 ± 4.749.6 ± 1.5
125 66.8 ± 16.752.8 ± 7.365.1 ± 17.351.8 ± 6.5
150 80.6 ± 20.650.9 ± 16.180.2 ± 20.549.9 ± 15.9
175 91.1 ± 15.668.9 ± 21.690.3 ± 16.567.7 ± 21.1
200 96.4 ± 8.786.0 ± 17.695.1 ± 9.884.2 ± 17.4
225 98.0 ± 9.390.1 ± 15.297.6 ± 10.389.2 ± 15.3
250 98.2 ± 8.687.3 ± 20.198.2 ± 8.786.7 ± 20.4
275 99.0 ± 4.982.7 ± 27.898.9 ± 5.682.8 ± 27.5
300 100.0 ± 0.186.4 ± 23.1100.0 ± 0.086.0 ± 23.2
325 100.0 ± 0.191.0 ± 15.899.9 ± 0.290.1 ± 16.3
350 100.0 ± 0.087.1 ± 21.4100.0 ± 0.086.7 ± 21.6
375 100.0 ± 0.088.6 ± 22.5100.0 ± 0.087.8 ± 22.4
400 100.0 ± 0.086.9 ± 24.3100.0 ± 0.086.4 ± 24.2

Downloads