imagining syntax

← mirror_v1

s1_e5_blk

done · peak unseen_mismatch 96.3

α schedule

α 1.0 ×240 α 2.0 ×240 α 3.0 ×240 α 4.0 ×240 α 5.0 ×240

direction
ascending
α range
1.0–5.0
stages
5

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 5.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.6 ± 1.349.1 ± 0.750.0 ± 2.050.2 ± 1.2
100 50.1 ± 1.750.3 ± 2.250.3 ± 1.850.0 ± 1.8
150 51.2 ± 1.849.7 ± 1.951.1 ± 1.248.5 ± 1.1
200 57.8 ± 15.646.8 ± 8.958.3 ± 15.147.6 ± 9.7
250 72.6 ± 21.743.3 ± 8.772.5 ± 21.343.4 ± 8.1
300 93.0 ± 13.644.5 ± 22.892.3 ± 14.945.8 ± 22.6
350 99.2 ± 2.349.0 ± 28.799.0 ± 2.950.1 ± 28.0
400 100.0 ± 0.082.2 ± 15.4100.0 ± 0.082.0 ± 15.6
450 100.0 ± 0.179.7 ± 20.999.9 ± 0.480.4 ± 19.8
500 99.7 ± 0.693.3 ± 14.599.2 ± 1.892.5 ± 14.2
550 98.9 ± 1.298.3 ± 1.797.8 ± 3.396.3 ± 3.2
600 98.1 ± 1.396.2 ± 2.495.8 ± 3.092.4 ± 3.9
650 96.3 ± 1.694.0 ± 2.891.2 ± 4.087.0 ± 4.2
700 95.6 ± 1.493.8 ± 2.289.3 ± 4.086.0 ± 3.8
750 93.0 ± 1.791.0 ± 3.384.4 ± 3.880.7 ± 4.0
800 91.7 ± 1.690.0 ± 2.380.6 ± 3.877.0 ± 3.4
850 90.7 ± 1.889.2 ± 2.478.5 ± 4.175.5 ± 3.4
900 89.5 ± 1.787.5 ± 2.375.3 ± 3.672.6 ± 3.3
950 88.7 ± 1.687.2 ± 1.773.8 ± 3.871.6 ± 3.3
1000 87.2 ± 1.585.8 ± 1.570.8 ± 3.069.2 ± 1.9
1050 86.9 ± 1.085.2 ± 1.069.2 ± 3.268.1 ± 2.4
1100 86.1 ± 1.384.7 ± 0.967.5 ± 3.767.0 ± 2.8
1150 86.7 ± 1.484.4 ± 1.767.9 ± 3.867.0 ± 3.3
1200 86.4 ± 1.284.9 ± 1.067.9 ± 3.667.1 ± 2.9

Downloads