imagining syntax

← budget_v1

T600

done · peak unseen_mismatch 99.8

α schedule

α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 5.0 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 0.7 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 3.1429 ×13 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 1.2857 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12 α 0.7 ×12

direction
mixed
α range
0.7–5.0
stages
48

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.5 ± 1.549.9 ± 1.349.8 ± 1.949.6 ± 2.2
50 50.9 ± 1.850.0 ± 1.250.2 ± 1.650.4 ± 1.5
75 54.0 ± 1.951.6 ± 1.951.1 ± 1.750.1 ± 2.2
100 62.4 ± 6.258.5 ± 4.654.2 ± 4.351.8 ± 2.1
125 73.9 ± 15.263.8 ± 10.468.7 ± 17.158.4 ± 9.7
150 89.5 ± 13.868.2 ± 15.187.7 ± 15.066.1 ± 14.3
175 98.1 ± 7.959.2 ± 25.198.0 ± 8.557.6 ± 24.8
200 100.0 ± 0.153.4 ± 31.399.9 ± 0.352.7 ± 31.2
225 100.0 ± 0.071.2 ± 31.1100.0 ± 0.070.4 ± 30.9
250 99.8 ± 0.389.4 ± 22.199.6 ± 1.188.0 ± 21.6
275 99.1 ± 1.294.0 ± 13.798.1 ± 2.691.2 ± 13.4
300 97.6 ± 2.093.2 ± 9.395.2 ± 3.888.0 ± 10.5
325 100.0 ± 0.199.7 ± 0.6100.0 ± 0.199.6 ± 0.7
350 100.0 ± 0.098.4 ± 6.9100.0 ± 0.098.4 ± 7.0
375 100.0 ± 0.099.8 ± 0.6100.0 ± 0.099.8 ± 0.7
400 100.0 ± 0.098.1 ± 7.1100.0 ± 0.097.5 ± 6.7
450 99.8 ± 0.398.6 ± 1.799.2 ± 1.295.9 ± 3.5
500 99.7 ± 0.398.9 ± 0.999.0 ± 0.994.7 ± 4.5
550 100.0 ± 0.099.8 ± 0.6100.0 ± 0.198.9 ± 1.7
600 100.0 ± 0.099.0 ± 3.399.9 ± 0.197.4 ± 4.3

Downloads