imagining syntax

← budget_v1

T300

done · peak unseen_mismatch 59.2

α schedule

α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 5.0 ×7 α 0.7 ×7 α 0.7 ×7 α 0.7 ×7 α 0.7 ×7 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 3.1429 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 1.2857 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6 α 0.7 ×6

direction
mixed
α range
0.7–5.0
stages
48

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.5 ± 1.549.9 ± 1.349.8 ± 1.949.6 ± 2.2
50 50.9 ± 1.850.0 ± 1.250.2 ± 1.650.4 ± 1.5
75 51.9 ± 1.650.0 ± 1.850.6 ± 1.850.2 ± 2.2
100 52.4 ± 2.749.8 ± 1.751.6 ± 2.648.7 ± 1.9
125 60.6 ± 12.548.3 ± 5.259.7 ± 12.848.3 ± 5.0
150 75.9 ± 19.759.0 ± 14.573.8 ± 20.357.9 ± 13.5
175 88.5 ± 14.560.5 ± 14.587.0 ± 15.859.2 ± 14.1
200 96.9 ± 9.847.5 ± 21.996.9 ± 9.446.8 ± 21.1
225 100.0 ± 0.252.4 ± 16.3100.0 ± 0.152.3 ± 16.0
250 100.0 ± 0.054.5 ± 26.8100.0 ± 0.053.7 ± 26.4
275 100.0 ± 0.052.6 ± 27.1100.0 ± 0.052.6 ± 27.1
300 100.0 ± 0.052.1 ± 25.6100.0 ± 0.051.8 ± 25.0

Downloads