imagining syntax

← mirror_v1

s3_e2_blk

done · peak unseen_mismatch 85.1

α schedule

α 3.0 ×600 α 2.0 ×600

direction
descending
α range
2.0–3.0
stages
2

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.3 ± 2.249.6 ± 0.850.0 ± 1.750.3 ± 1.6
100 55.9 ± 7.453.6 ± 4.652.7 ± 5.750.5 ± 3.7
150 76.3 ± 12.572.0 ± 11.769.1 ± 13.063.1 ± 11.1
200 88.2 ± 4.386.4 ± 4.678.2 ± 8.275.1 ± 6.9
250 90.7 ± 1.689.4 ± 1.679.0 ± 4.976.2 ± 3.6
300 91.8 ± 1.590.3 ± 1.578.3 ± 4.375.5 ± 4.1
350 91.7 ± 1.090.3 ± 1.277.0 ± 3.173.9 ± 2.3
400 92.6 ± 1.290.7 ± 1.679.5 ± 5.074.6 ± 4.8
450 92.4 ± 0.890.8 ± 1.477.1 ± 3.273.7 ± 2.8
500 93.2 ± 0.991.1 ± 1.380.0 ± 3.373.9 ± 4.2
550 92.5 ± 1.290.8 ± 1.478.1 ± 4.472.6 ± 5.7
600 93.4 ± 0.891.5 ± 1.379.0 ± 3.773.8 ± 4.2
650 97.3 ± 0.895.1 ± 1.287.3 ± 3.680.2 ± 4.5
700 97.8 ± 0.796.1 ± 1.289.8 ± 1.782.2 ± 4.9
750 98.2 ± 0.896.3 ± 1.389.7 ± 3.782.4 ± 6.3
800 98.1 ± 0.796.4 ± 0.590.7 ± 1.983.7 ± 5.5
850 98.4 ± 0.697.0 ± 1.092.1 ± 3.383.5 ± 6.7
900 98.5 ± 0.597.0 ± 1.191.5 ± 2.183.2 ± 6.4
950 98.4 ± 0.896.6 ± 1.791.2 ± 3.483.4 ± 7.8
1000 98.4 ± 0.796.6 ± 1.790.9 ± 2.782.6 ± 7.8
1050 98.6 ± 0.597.0 ± 1.192.5 ± 1.784.1 ± 7.2
1100 98.6 ± 0.797.1 ± 1.192.2 ± 2.885.1 ± 6.1
1150 98.9 ± 0.697.2 ± 1.292.2 ± 2.284.1 ± 5.7
1200 98.7 ± 0.697.2 ± 1.592.9 ± 2.983.3 ± 9.4

Downloads