imagining syntax

← mirror_v1

s5_e4_blk

done · peak unseen_mismatch 68.8

α schedule

α 5.0 ×600 α 4.0 ×600

direction
descending
α range
4.0–5.0
stages
2

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 59.6 ± 6.456.9 ± 4.652.8 ± 3.751.7 ± 3.0
150 76.5 ± 5.574.3 ± 5.662.2 ± 5.959.1 ± 4.4
200 79.5 ± 1.978.0 ± 2.060.5 ± 3.559.9 ± 3.0
250 79.8 ± 1.878.6 ± 1.660.5 ± 3.159.4 ± 3.1
300 82.4 ± 1.681.0 ± 1.863.4 ± 3.662.4 ± 3.8
350 83.8 ± 2.382.1 ± 2.265.8 ± 5.665.2 ± 5.9
400 83.3 ± 1.781.8 ± 1.564.7 ± 2.362.0 ± 3.1
450 83.3 ± 1.881.3 ± 1.964.3 ± 3.361.6 ± 2.8
500 85.0 ± 2.083.3 ± 2.666.1 ± 5.563.1 ± 5.4
550 84.0 ± 2.582.9 ± 2.364.5 ± 4.661.7 ± 4.8
600 84.8 ± 2.183.4 ± 2.466.0 ± 3.462.6 ± 4.7
650 86.8 ± 2.385.1 ± 1.967.7 ± 5.864.5 ± 6.0
700 88.1 ± 1.285.5 ± 1.670.1 ± 3.565.7 ± 4.1
750 87.5 ± 1.286.0 ± 1.369.3 ± 4.563.8 ± 4.2
800 88.3 ± 1.886.8 ± 2.069.8 ± 4.966.7 ± 4.8
850 89.2 ± 1.287.0 ± 1.570.9 ± 4.267.4 ± 4.7
900 88.8 ± 1.387.3 ± 1.370.2 ± 5.165.9 ± 4.7
950 88.8 ± 1.787.2 ± 1.470.6 ± 4.566.6 ± 4.3
1000 89.1 ± 1.487.9 ± 1.371.0 ± 4.367.4 ± 4.8
1050 89.5 ± 1.688.0 ± 1.671.8 ± 3.467.5 ± 4.5
1100 89.7 ± 1.587.7 ± 0.972.9 ± 3.967.6 ± 3.8
1150 89.9 ± 1.188.2 ± 1.772.0 ± 3.567.5 ± 4.7
1200 90.5 ± 1.288.1 ± 1.473.2 ± 3.068.8 ± 3.6

Downloads