imagining syntax

← mirror_v1

s4_e3_blk

done · peak unseen_mismatch 75.0

α schedule

α 4.0 ×600 α 3.0 ×600

direction
descending
α range
3.0–4.0
stages
2

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.7 ± 7.356.1 ± 6.152.6 ± 4.251.5 ± 2.9
150 76.9 ± 6.375.5 ± 5.265.1 ± 6.561.0 ± 5.8
200 82.0 ± 2.580.4 ± 1.764.6 ± 3.863.1 ± 3.1
250 83.9 ± 2.082.2 ± 2.064.0 ± 4.262.4 ± 3.2
300 85.9 ± 1.684.5 ± 2.267.5 ± 4.966.6 ± 4.4
350 88.1 ± 1.886.5 ± 1.971.1 ± 4.868.8 ± 4.5
400 87.5 ± 1.585.7 ± 1.868.1 ± 3.765.1 ± 3.1
450 87.7 ± 1.685.7 ± 2.268.7 ± 5.966.0 ± 5.3
500 89.5 ± 1.887.9 ± 2.472.6 ± 6.468.8 ± 5.4
550 88.7 ± 2.186.8 ± 2.670.7 ± 5.766.5 ± 5.7
600 88.7 ± 1.786.5 ± 2.070.2 ± 4.466.4 ± 4.3
650 92.2 ± 2.189.7 ± 1.975.2 ± 4.969.6 ± 5.1
700 92.4 ± 1.389.8 ± 1.776.7 ± 4.170.2 ± 3.9
750 93.0 ± 1.490.9 ± 1.977.0 ± 5.471.4 ± 5.9
800 93.0 ± 1.690.7 ± 2.277.3 ± 5.971.7 ± 6.2
850 93.4 ± 1.691.0 ± 2.579.6 ± 4.572.7 ± 4.9
900 93.6 ± 1.091.4 ± 2.278.2 ± 3.571.3 ± 4.8
950 94.0 ± 1.491.2 ± 1.779.4 ± 5.972.9 ± 6.6
1000 94.0 ± 1.191.8 ± 2.079.8 ± 3.873.1 ± 5.3
1050 94.3 ± 1.092.2 ± 1.480.7 ± 3.875.0 ± 3.6
1100 94.4 ± 1.392.4 ± 1.481.6 ± 5.674.6 ± 5.7
1150 94.7 ± 1.092.4 ± 1.779.9 ± 3.773.8 ± 4.9
1200 94.6 ± 0.792.5 ± 1.281.0 ± 3.174.6 ± 4.6

Downloads