imagining syntax

← mirror_v1

s2_e5_blk

done · peak unseen_mismatch 96.5

α schedule

α 2.0 ×300 α 3.0 ×300 α 4.0 ×300 α 5.0 ×300

direction
ascending
α range
2.0–5.0
stages
4

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 5.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.5 ± 1.949.9 ± 0.550.1 ± 1.950.1 ± 1.5
100 51.8 ± 1.750.8 ± 1.950.5 ± 1.750.4 ± 1.9
150 63.7 ± 13.655.5 ± 7.262.4 ± 12.652.6 ± 6.4
200 80.6 ± 21.267.9 ± 17.079.9 ± 21.966.8 ± 15.8
250 96.6 ± 6.591.5 ± 8.495.5 ± 8.688.7 ± 10.9
300 99.3 ± 0.798.5 ± 0.998.6 ± 1.696.5 ± 1.9
350 97.6 ± 1.196.1 ± 1.694.1 ± 2.391.6 ± 3.6
400 94.8 ± 1.293.5 ± 1.787.5 ± 3.784.7 ± 4.8
450 94.4 ± 1.292.5 ± 1.684.9 ± 3.582.7 ± 3.8
500 92.7 ± 1.191.0 ± 1.780.8 ± 2.578.4 ± 3.3
550 92.3 ± 1.191.1 ± 2.179.1 ± 2.676.5 ± 3.6
600 92.5 ± 1.191.3 ± 1.479.7 ± 2.676.7 ± 3.8
650 90.5 ± 1.188.9 ± 1.776.0 ± 2.773.9 ± 3.1
700 90.4 ± 1.389.2 ± 1.476.2 ± 3.974.1 ± 3.9
750 90.3 ± 0.688.7 ± 2.074.3 ± 2.971.6 ± 3.8
800 90.6 ± 1.189.8 ± 2.076.6 ± 2.574.1 ± 3.2
850 90.3 ± 1.089.4 ± 1.975.7 ± 3.973.3 ± 4.7
900 90.3 ± 1.189.2 ± 2.175.1 ± 3.172.2 ± 3.6
950 89.8 ± 0.988.5 ± 2.073.1 ± 2.371.0 ± 2.6
1000 89.0 ± 1.187.9 ± 2.172.9 ± 3.371.1 ± 3.2
1050 89.2 ± 1.488.3 ± 1.772.6 ± 2.571.3 ± 2.8
1100 89.7 ± 1.388.4 ± 2.575.2 ± 3.672.5 ± 4.8
1150 89.4 ± 1.287.8 ± 2.073.1 ± 3.471.6 ± 3.3
1200 89.2 ± 1.288.5 ± 2.173.8 ± 2.571.7 ± 3.6

Downloads