imagining syntax

← slopesweep_v1

s5_e5

done · peak unseen_mismatch 66.0

α schedule

α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50

direction
constant
α range
5.0–5.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 5.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.3 ± 1.550.3 ± 1.350.3 ± 1.550.3 ± 1.8
100 62.0 ± 6.558.2 ± 5.254.0 ± 3.751.2 ± 2.1
150 77.9 ± 3.675.9 ± 3.064.6 ± 4.861.5 ± 4.3
200 80.0 ± 2.778.8 ± 2.962.8 ± 3.761.2 ± 3.6
250 80.2 ± 3.279.8 ± 2.864.4 ± 3.962.2 ± 4.1
300 81.6 ± 3.480.9 ± 2.864.5 ± 6.163.1 ± 5.3
350 81.7 ± 2.180.9 ± 1.463.0 ± 3.361.0 ± 3.5
400 83.7 ± 2.083.5 ± 2.067.1 ± 4.364.8 ± 4.5
450 82.6 ± 1.982.2 ± 2.164.8 ± 4.262.1 ± 4.7
500 84.1 ± 3.183.0 ± 3.066.6 ± 6.363.4 ± 6.0
550 84.0 ± 2.082.4 ± 2.365.2 ± 3.061.8 ± 3.4
600 85.1 ± 2.483.4 ± 2.468.1 ± 4.964.4 ± 4.6
650 84.9 ± 1.583.3 ± 1.766.8 ± 3.863.2 ± 3.7
700 85.7 ± 1.883.4 ± 2.267.6 ± 3.763.5 ± 3.7
750 85.9 ± 1.784.4 ± 1.568.8 ± 3.665.1 ± 3.4
800 85.4 ± 2.884.1 ± 2.967.8 ± 4.463.6 ± 5.0
850 86.2 ± 1.785.1 ± 2.168.9 ± 3.864.2 ± 4.8
900 85.9 ± 1.584.6 ± 1.867.9 ± 3.563.9 ± 4.6
950 86.6 ± 1.385.1 ± 1.669.0 ± 4.465.1 ± 4.9
1000 86.6 ± 1.785.1 ± 2.169.3 ± 3.865.1 ± 5.1
1050 86.5 ± 1.885.4 ± 1.569.6 ± 3.165.3 ± 4.2
1100 87.1 ± 1.985.3 ± 1.868.9 ± 2.864.8 ± 3.7
1150 87.7 ± 1.686.1 ± 1.969.1 ± 3.865.6 ± 4.7
1200 87.5 ± 1.186.0 ± 1.669.2 ± 3.266.0 ± 3.9

Downloads