imagining syntax

← schedopt_granularity

burst_16

done · peak unseen_mismatch 94.5

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.7 ×25 α 0.7 ×25 α 3.1429 ×25 α 3.1429 ×25 α 3.1429 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25 α 1.2857 ×25 α 1.2857 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25

direction
mixed
α range
0.7–5.0
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.1 ± 1.250.5 ± 1.349.5 ± 1.550.1 ± 1.8
50 51.5 ± 1.750.5 ± 1.550.2 ± 1.849.3 ± 1.4
75 53.8 ± 2.151.4 ± 1.850.7 ± 2.549.7 ± 1.6
100 56.0 ± 8.351.7 ± 3.653.9 ± 8.450.9 ± 2.9
125 64.3 ± 15.051.7 ± 4.562.2 ± 15.650.4 ± 3.7
150 83.3 ± 15.964.8 ± 12.781.6 ± 16.862.5 ± 11.5
175 93.1 ± 11.385.1 ± 13.091.1 ± 11.681.9 ± 13.1
200 95.1 ± 7.391.0 ± 10.192.0 ± 9.586.5 ± 11.1
225 99.1 ± 3.893.9 ± 13.098.9 ± 4.592.7 ± 13.9
250 100.0 ± 0.094.0 ± 13.2100.0 ± 0.093.2 ± 13.6
275 100.0 ± 0.091.1 ± 16.1100.0 ± 0.090.9 ± 16.0
300 100.0 ± 0.194.3 ± 14.299.9 ± 0.293.4 ± 14.0
325 100.0 ± 0.094.5 ± 17.499.8 ± 0.293.7 ± 17.4
350 100.0 ± 0.092.9 ± 18.9100.0 ± 0.092.7 ± 18.8
375 100.0 ± 0.094.7 ± 14.2100.0 ± 0.094.5 ± 14.0
400 100.0 ± 0.091.8 ± 17.4100.0 ± 0.091.1 ± 17.6

Downloads