imagining syntax

← mirror_v1

s0_e3_blk

done · peak unseen_mismatch 93.7

α schedule

α 0.0 ×300 α 1.0 ×300 α 2.0 ×300 α 3.0 ×300

direction
ascending
α range
0.0–3.0
stages
4

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.4 ± 1.649.9 ± 1.149.8 ± 1.949.6 ± 1.9
100 50.3 ± 1.450.1 ± 2.249.8 ± 1.550.0 ± 1.9
150 52.9 ± 4.948.8 ± 3.253.3 ± 5.447.9 ± 2.6
200 57.3 ± 16.044.2 ± 13.457.9 ± 15.645.0 ± 14.2
250 68.8 ± 21.044.6 ± 11.968.0 ± 20.945.0 ± 11.8
300 80.4 ± 24.039.6 ± 13.080.6 ± 23.840.6 ± 12.5
350 90.5 ± 18.930.9 ± 24.490.4 ± 19.031.3 ± 25.3
400 97.0 ± 8.935.2 ± 28.697.1 ± 8.735.9 ± 28.6
450 100.0 ± 0.027.8 ± 31.8100.0 ± 0.028.1 ± 32.0
500 100.0 ± 0.029.3 ± 31.0100.0 ± 0.029.6 ± 31.5
550 100.0 ± 0.026.2 ± 26.4100.0 ± 0.026.3 ± 26.7
600 100.0 ± 0.040.7 ± 23.5100.0 ± 0.040.6 ± 22.9
650 100.0 ± 0.049.0 ± 33.1100.0 ± 0.048.8 ± 33.1
700 100.0 ± 0.053.5 ± 27.3100.0 ± 0.053.7 ± 27.1
750 100.0 ± 0.063.7 ± 24.7100.0 ± 0.063.7 ± 24.7
800 100.0 ± 0.081.1 ± 22.4100.0 ± 0.080.6 ± 22.9
850 99.9 ± 0.190.7 ± 14.199.9 ± 0.189.3 ± 14.4
900 99.8 ± 0.395.5 ± 7.399.0 ± 1.993.7 ± 8.5
950 98.8 ± 1.093.7 ± 12.197.4 ± 3.191.4 ± 12.1
1000 97.7 ± 1.196.8 ± 1.894.3 ± 3.192.4 ± 4.1
1050 96.4 ± 1.495.0 ± 1.791.4 ± 3.888.9 ± 4.4
1100 95.8 ± 1.694.8 ± 1.989.8 ± 4.287.1 ± 5.3
1150 94.6 ± 1.493.4 ± 1.486.0 ± 2.384.1 ± 4.1
1200 93.6 ± 1.392.2 ± 1.384.3 ± 3.081.4 ± 4.6

Downloads