imagining syntax

← mirror_v1

s1_e3_blk

done · peak unseen_mismatch 96.0

α schedule

α 1.0 ×400 α 2.0 ×400 α 3.0 ×400

direction
ascending
α range
1.0–3.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.6 ± 1.349.1 ± 0.750.0 ± 2.050.2 ± 1.2
100 50.1 ± 1.750.3 ± 2.250.3 ± 1.850.0 ± 1.8
150 51.2 ± 1.849.7 ± 1.951.1 ± 1.248.5 ± 1.1
200 57.8 ± 15.646.8 ± 8.958.3 ± 15.147.6 ± 9.7
250 71.9 ± 20.141.9 ± 10.972.1 ± 19.341.2 ± 9.8
300 88.1 ± 18.532.0 ± 21.688.1 ± 17.732.5 ± 20.6
350 100.0 ± 0.039.0 ± 27.4100.0 ± 0.039.3 ± 27.7
400 100.0 ± 0.036.4 ± 24.8100.0 ± 0.036.3 ± 25.2
450 100.0 ± 0.047.1 ± 30.5100.0 ± 0.047.2 ± 30.2
500 100.0 ± 0.068.4 ± 23.7100.0 ± 0.068.4 ± 24.2
550 100.0 ± 0.171.9 ± 30.399.7 ± 0.772.7 ± 29.0
600 99.9 ± 0.377.6 ± 30.199.6 ± 1.177.5 ± 29.4
650 99.8 ± 0.488.2 ± 20.499.6 ± 1.087.6 ± 19.9
700 99.4 ± 0.896.3 ± 4.198.7 ± 2.194.8 ± 4.5
750 99.0 ± 0.998.4 ± 1.197.9 ± 1.796.0 ± 2.4
800 98.7 ± 0.898.3 ± 1.296.5 ± 2.695.5 ± 2.8
850 96.8 ± 1.595.4 ± 2.090.8 ± 3.289.1 ± 2.4
900 95.3 ± 1.694.5 ± 2.388.3 ± 3.087.3 ± 2.8
950 94.6 ± 1.293.5 ± 1.786.1 ± 2.484.2 ± 2.1
1000 93.5 ± 1.392.5 ± 1.883.4 ± 3.182.0 ± 3.1
1050 92.4 ± 1.091.6 ± 1.381.3 ± 2.680.3 ± 2.9
1100 92.2 ± 1.191.7 ± 1.281.2 ± 3.480.0 ± 3.6
1150 91.9 ± 0.791.2 ± 1.080.0 ± 3.778.7 ± 2.7
1200 91.7 ± 1.091.0 ± 0.979.5 ± 2.777.7 ± 3.4

Downloads