imagining syntax

← slopesweep_v1

s2_e1

done · peak unseen_mismatch 95.8

α schedule

α 2.0 ×50 α 1.9565 ×50 α 1.913 ×50 α 1.8696 ×50 α 1.8261 ×50 α 1.7826 ×50 α 1.7391 ×50 α 1.6957 ×50 α 1.6522 ×50 α 1.6087 ×50 α 1.5652 ×50 α 1.5217 ×50 α 1.4783 ×50 α 1.4348 ×50 α 1.3913 ×50 α 1.3478 ×50 α 1.3043 ×50 α 1.2609 ×50 α 1.2174 ×50 α 1.1739 ×50 α 1.1304 ×50 α 1.087 ×50 α 1.0435 ×50 α 1.0 ×50

direction
descending
α range
1.0–2.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.2 ± 0.949.3 ± 0.950.0 ± 1.550.5 ± 1.4
100 51.3 ± 2.049.8 ± 1.551.1 ± 1.449.3 ± 1.4
150 63.7 ± 10.551.2 ± 6.960.8 ± 10.651.8 ± 5.3
200 95.8 ± 5.262.6 ± 24.494.8 ± 6.560.8 ± 22.8
250 99.8 ± 0.681.9 ± 19.299.5 ± 1.680.6 ± 18.5
300 99.8 ± 0.285.4 ± 15.699.4 ± 1.084.5 ± 14.6
350 99.7 ± 0.489.6 ± 14.498.9 ± 1.787.3 ± 13.9
400 99.2 ± 0.896.1 ± 4.298.4 ± 2.194.1 ± 4.3
450 99.2 ± 0.697.4 ± 2.797.2 ± 2.293.8 ± 3.7
500 99.2 ± 0.798.3 ± 0.996.9 ± 2.393.4 ± 3.7
550 99.5 ± 0.598.5 ± 1.097.9 ± 1.895.8 ± 2.3
600 99.2 ± 0.698.3 ± 0.996.7 ± 2.893.8 ± 3.7
650 99.2 ± 0.498.3 ± 0.897.2 ± 1.693.2 ± 3.3
700 99.5 ± 0.298.5 ± 0.997.0 ± 1.893.3 ± 4.1
750 99.7 ± 0.298.8 ± 0.897.8 ± 1.393.1 ± 4.6
800 99.7 ± 0.298.9 ± 0.697.8 ± 1.493.9 ± 3.5
850 99.8 ± 0.299.0 ± 0.998.6 ± 1.094.6 ± 3.4
900 99.8 ± 0.198.9 ± 0.997.9 ± 1.593.3 ± 4.4
950 99.9 ± 0.199.4 ± 0.698.8 ± 1.095.3 ± 4.3
1000 99.9 ± 0.199.2 ± 0.899.0 ± 1.094.9 ± 4.7
1050 100.0 ± 0.198.7 ± 1.998.9 ± 1.593.8 ± 7.1
1100 100.0 ± 0.199.3 ± 0.799.4 ± 0.695.6 ± 4.6
1150 100.0 ± 0.198.6 ± 2.599.1 ± 0.793.2 ± 6.8
1200 100.0 ± 0.097.1 ± 7.499.5 ± 0.592.4 ± 9.8

Downloads