imagining syntax

← mirror_v1

s3_e1_blk

done · peak unseen_mismatch 95.5

α schedule

α 3.0 ×400 α 2.0 ×400 α 1.0 ×400

direction
descending
α range
1.0–3.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.3 ± 2.249.6 ± 0.850.0 ± 1.750.3 ± 1.6
100 55.9 ± 7.453.6 ± 4.652.7 ± 5.750.5 ± 3.7
150 76.3 ± 12.572.0 ± 11.769.1 ± 13.063.1 ± 11.1
200 88.2 ± 4.386.4 ± 4.678.2 ± 8.275.1 ± 6.9
250 90.7 ± 1.689.4 ± 1.679.0 ± 4.976.2 ± 3.6
300 91.8 ± 1.590.3 ± 1.578.3 ± 4.375.5 ± 4.1
350 91.7 ± 1.090.3 ± 1.277.0 ± 3.173.9 ± 2.3
400 92.6 ± 1.290.7 ± 1.679.5 ± 5.074.6 ± 4.8
450 96.4 ± 0.894.2 ± 1.485.5 ± 4.079.3 ± 4.9
500 97.2 ± 0.995.3 ± 1.287.8 ± 2.382.0 ± 3.7
550 97.6 ± 1.396.2 ± 1.388.0 ± 4.382.6 ± 6.0
600 97.6 ± 0.795.9 ± 0.888.7 ± 3.482.0 ± 4.5
650 98.2 ± 0.796.7 ± 1.090.8 ± 2.883.7 ± 5.5
700 98.0 ± 0.796.6 ± 0.791.2 ± 2.283.6 ± 3.9
750 97.9 ± 1.096.3 ± 0.990.3 ± 3.982.7 ± 3.8
800 98.4 ± 0.797.2 ± 1.092.2 ± 1.985.5 ± 5.0
850 100.0 ± 0.199.7 ± 0.398.9 ± 0.895.5 ± 3.9
900 100.0 ± 0.099.7 ± 0.399.1 ± 0.794.6 ± 5.0
950 100.0 ± 0.099.5 ± 0.699.6 ± 0.692.4 ± 6.7
1000 100.0 ± 0.099.4 ± 0.699.6 ± 0.292.0 ± 7.8
1050 100.0 ± 0.198.7 ± 1.699.0 ± 0.787.5 ± 11.8
1100 100.0 ± 0.198.7 ± 1.399.3 ± 0.685.8 ± 11.9
1150 100.0 ± 0.098.6 ± 1.198.7 ± 0.985.1 ± 10.6
1200 100.0 ± 0.098.2 ± 1.699.1 ± 0.883.3 ± 11.5

Downloads