imagining syntax

← mirror_v1

s3_e5_blk

done · peak unseen_mismatch 76.2

α schedule

α 3.0 ×400 α 4.0 ×400 α 5.0 ×400

direction
ascending
α range
3.0–5.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 5.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.3 ± 2.249.6 ± 0.850.0 ± 1.750.3 ± 1.6
100 55.9 ± 7.453.6 ± 4.652.7 ± 5.750.5 ± 3.7
150 76.3 ± 12.572.0 ± 11.769.1 ± 13.063.1 ± 11.1
200 88.2 ± 4.386.4 ± 4.678.2 ± 8.275.1 ± 6.9
250 90.7 ± 1.689.4 ± 1.679.0 ± 4.976.2 ± 3.6
300 91.8 ± 1.590.3 ± 1.578.3 ± 4.375.5 ± 4.1
350 91.7 ± 1.090.3 ± 1.277.0 ± 3.173.9 ± 2.3
400 92.6 ± 1.290.7 ± 1.679.5 ± 5.074.6 ± 4.8
450 90.5 ± 1.588.5 ± 1.375.2 ± 2.570.7 ± 2.4
500 90.5 ± 2.188.3 ± 1.875.8 ± 4.072.4 ± 4.0
550 90.3 ± 2.388.5 ± 2.074.6 ± 5.969.0 ± 5.3
600 89.9 ± 1.788.0 ± 1.574.5 ± 3.069.1 ± 2.7
650 90.4 ± 1.489.0 ± 1.475.1 ± 3.269.9 ± 3.7
700 90.4 ± 1.288.4 ± 1.274.2 ± 3.069.4 ± 3.2
750 91.3 ± 1.389.4 ± 1.776.3 ± 3.471.2 ± 3.3
800 91.1 ± 1.589.5 ± 1.476.1 ± 3.771.2 ± 4.9
850 89.4 ± 1.487.8 ± 1.573.9 ± 2.568.9 ± 3.9
900 89.4 ± 2.087.9 ± 1.973.1 ± 4.669.3 ± 4.6
950 89.4 ± 1.488.0 ± 1.674.1 ± 2.770.3 ± 4.2
1000 89.2 ± 1.488.0 ± 1.673.9 ± 4.369.1 ± 4.8
1050 89.5 ± 1.487.8 ± 1.774.0 ± 3.569.6 ± 4.2
1100 89.5 ± 1.688.0 ± 1.673.8 ± 3.870.5 ± 4.6
1150 89.4 ± 1.287.5 ± 1.874.4 ± 3.370.3 ± 5.1
1200 89.8 ± 1.287.8 ± 2.074.4 ± 2.869.9 ± 4.8

Downloads