imagining syntax

← mirror_v1

s1_e0_blk

done · peak unseen_mismatch 59.5

α schedule

α 1.0 ×600 α 0.0 ×600

direction
descending
α range
0.0–1.0
stages
2

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.6 ± 1.349.1 ± 0.750.0 ± 2.050.2 ± 1.2
100 50.1 ± 1.750.3 ± 2.250.3 ± 1.850.0 ± 1.8
150 51.2 ± 1.849.7 ± 1.951.1 ± 1.248.5 ± 1.1
200 57.8 ± 15.646.8 ± 8.958.3 ± 15.147.6 ± 9.7
250 71.9 ± 20.141.9 ± 10.972.1 ± 19.341.2 ± 9.8
300 88.1 ± 18.532.0 ± 21.688.1 ± 17.732.5 ± 20.6
350 100.0 ± 0.039.0 ± 27.4100.0 ± 0.039.3 ± 27.7
400 100.0 ± 0.036.4 ± 24.8100.0 ± 0.036.3 ± 25.2
450 100.0 ± 0.032.9 ± 22.1100.0 ± 0.033.5 ± 22.8
500 100.0 ± 0.045.8 ± 30.8100.0 ± 0.046.8 ± 30.7
550 100.0 ± 0.047.6 ± 22.1100.0 ± 0.048.1 ± 22.2
600 100.0 ± 0.052.0 ± 27.8100.0 ± 0.053.1 ± 27.6
650 100.0 ± 0.059.1 ± 31.7100.0 ± 0.059.5 ± 31.7
700 100.0 ± 0.046.3 ± 32.1100.0 ± 0.046.9 ± 32.2
750 100.0 ± 0.041.1 ± 24.6100.0 ± 0.041.3 ± 24.9
800 100.0 ± 0.046.7 ± 33.0100.0 ± 0.046.6 ± 33.2
850 100.0 ± 0.035.3 ± 32.0100.0 ± 0.034.6 ± 30.8
900 100.0 ± 0.043.6 ± 25.8100.0 ± 0.043.7 ± 26.1
950 100.0 ± 0.023.1 ± 18.8100.0 ± 0.022.6 ± 17.9
1000 100.0 ± 0.036.7 ± 36.7100.0 ± 0.036.6 ± 36.4
1050 100.0 ± 0.039.8 ± 35.3100.0 ± 0.039.9 ± 35.5
1100 100.0 ± 0.039.6 ± 39.5100.0 ± 0.040.3 ± 40.0
1150 100.0 ± 0.033.0 ± 42.6100.0 ± 0.033.4 ± 42.6
1200 100.0 ± 0.035.4 ± 30.3100.0 ± 0.035.3 ± 30.1

Downloads