imagining syntax

← mirror_v1

s4_e2_blk

done · peak unseen_mismatch 84.0

α schedule

α 4.0 ×400 α 3.0 ×400 α 2.0 ×400

direction
descending
α range
2.0–4.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.7 ± 7.356.1 ± 6.152.6 ± 4.251.5 ± 2.9
150 76.9 ± 6.375.5 ± 5.265.1 ± 6.561.0 ± 5.8
200 82.0 ± 2.580.4 ± 1.764.6 ± 3.863.1 ± 3.1
250 83.9 ± 2.082.2 ± 2.064.0 ± 4.262.4 ± 3.2
300 85.9 ± 1.684.5 ± 2.267.5 ± 4.966.6 ± 4.4
350 88.1 ± 1.886.5 ± 1.971.1 ± 4.868.8 ± 4.5
400 87.5 ± 1.585.7 ± 1.868.1 ± 3.765.1 ± 3.1
450 90.8 ± 1.688.8 ± 2.073.6 ± 4.469.3 ± 5.0
500 91.8 ± 1.688.7 ± 2.776.1 ± 6.170.1 ± 6.2
550 92.3 ± 1.390.3 ± 1.976.0 ± 5.470.1 ± 5.7
600 92.7 ± 1.390.3 ± 1.177.3 ± 5.071.1 ± 3.5
650 93.0 ± 1.590.7 ± 2.378.6 ± 3.672.3 ± 5.1
700 93.2 ± 1.491.2 ± 1.778.2 ± 3.671.5 ± 4.1
750 93.3 ± 1.290.6 ± 1.578.4 ± 4.072.8 ± 3.8
800 93.9 ± 0.891.6 ± 1.979.1 ± 3.872.8 ± 4.4
850 97.2 ± 1.295.2 ± 1.887.3 ± 4.079.7 ± 6.0
900 97.7 ± 0.796.2 ± 1.788.6 ± 3.781.5 ± 5.5
950 98.0 ± 0.796.3 ± 1.789.6 ± 2.782.7 ± 5.9
1000 98.1 ± 0.396.5 ± 1.390.0 ± 2.881.5 ± 5.3
1050 98.5 ± 0.596.5 ± 1.690.8 ± 2.183.1 ± 6.0
1100 98.3 ± 0.596.8 ± 1.091.0 ± 2.282.6 ± 4.1
1150 98.6 ± 0.597.1 ± 0.992.2 ± 2.384.0 ± 4.8
1200 98.7 ± 0.396.9 ± 0.891.8 ± 2.483.2 ± 5.9

Downloads