imagining syntax

← mirror_v1

s5_e5

done · peak unseen_mismatch 66.2

α schedule

α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50 α 5.0 ×50

direction
constant
α range
5.0–5.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 5.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 60.2 ± 7.158.2 ± 6.853.9 ± 4.652.4 ± 4.1
150 75.1 ± 5.274.1 ± 5.360.7 ± 3.658.2 ± 3.8
200 79.5 ± 1.877.8 ± 1.462.5 ± 3.360.9 ± 3.3
250 80.9 ± 2.379.8 ± 1.462.2 ± 3.260.6 ± 2.4
300 82.3 ± 2.380.8 ± 2.964.5 ± 3.863.1 ± 3.0
350 84.2 ± 2.382.5 ± 2.565.1 ± 3.963.3 ± 3.4
400 83.3 ± 1.581.5 ± 1.964.3 ± 1.461.6 ± 2.5
450 84.5 ± 2.082.0 ± 2.364.1 ± 4.060.4 ± 4.1
500 84.5 ± 1.882.3 ± 2.166.0 ± 4.362.0 ± 5.0
550 85.0 ± 2.082.9 ± 2.866.7 ± 6.563.3 ± 7.4
600 85.3 ± 1.883.4 ± 1.867.3 ± 3.362.9 ± 3.9
650 86.1 ± 1.584.0 ± 1.667.2 ± 4.663.2 ± 5.4
700 85.7 ± 1.783.6 ± 1.466.0 ± 4.063.0 ± 3.8
750 86.3 ± 1.384.0 ± 1.668.2 ± 2.963.2 ± 3.4
800 85.9 ± 1.983.5 ± 1.667.3 ± 3.363.8 ± 3.5
850 86.8 ± 1.084.2 ± 1.868.3 ± 5.163.8 ± 6.0
900 86.2 ± 1.483.5 ± 1.467.9 ± 4.062.6 ± 4.6
950 87.2 ± 1.484.5 ± 1.669.8 ± 3.964.2 ± 4.7
1000 86.8 ± 1.284.7 ± 1.768.1 ± 3.563.6 ± 3.6
1050 87.8 ± 1.085.1 ± 1.669.4 ± 3.264.9 ± 4.5
1100 87.3 ± 1.584.8 ± 1.969.0 ± 3.964.2 ± 3.8
1150 87.6 ± 1.385.5 ± 1.469.3 ± 3.665.7 ± 4.3
1200 87.8 ± 1.385.8 ± 0.970.5 ± 3.266.2 ± 3.9

Downloads