imagining syntax

← mirror_v1

s1_e2_blk

done · peak unseen_mismatch 98.4

α schedule

α 1.0 ×600 α 2.0 ×600

direction
ascending
α range
1.0–2.0
stages
2

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.6 ± 1.349.1 ± 0.750.0 ± 2.050.2 ± 1.2
100 50.1 ± 1.750.3 ± 2.250.3 ± 1.850.0 ± 1.8
150 51.2 ± 1.849.7 ± 1.951.1 ± 1.248.5 ± 1.1
200 57.8 ± 15.646.8 ± 8.958.3 ± 15.147.6 ± 9.7
250 71.9 ± 20.141.9 ± 10.972.1 ± 19.341.2 ± 9.8
300 88.1 ± 18.532.0 ± 21.688.1 ± 17.732.5 ± 20.6
350 100.0 ± 0.039.0 ± 27.4100.0 ± 0.039.3 ± 27.7
400 100.0 ± 0.036.4 ± 24.8100.0 ± 0.036.3 ± 25.2
450 100.0 ± 0.032.9 ± 22.1100.0 ± 0.033.5 ± 22.8
500 100.0 ± 0.045.8 ± 30.8100.0 ± 0.046.8 ± 30.7
550 100.0 ± 0.047.6 ± 22.1100.0 ± 0.048.1 ± 22.2
600 100.0 ± 0.052.0 ± 27.8100.0 ± 0.053.1 ± 27.6
650 100.0 ± 0.079.2 ± 22.7100.0 ± 0.079.8 ± 22.0
700 100.0 ± 0.174.0 ± 27.799.7 ± 0.973.8 ± 26.9
750 99.9 ± 0.290.1 ± 14.799.6 ± 1.289.8 ± 13.9
800 99.8 ± 0.595.9 ± 5.899.4 ± 1.795.8 ± 5.1
850 99.6 ± 0.799.1 ± 1.199.4 ± 1.398.4 ± 2.0
900 99.0 ± 1.098.2 ± 1.897.8 ± 2.396.3 ± 3.6
950 98.7 ± 1.397.9 ± 1.796.5 ± 3.194.5 ± 4.6
1000 98.4 ± 1.297.3 ± 1.794.9 ± 3.892.7 ± 4.2
1050 98.0 ± 1.197.1 ± 1.394.4 ± 2.791.8 ± 3.7
1100 97.8 ± 1.096.6 ± 1.493.8 ± 3.390.8 ± 4.1
1150 97.5 ± 1.196.3 ± 1.492.8 ± 4.490.0 ± 4.9
1200 97.3 ± 1.396.2 ± 1.490.8 ± 3.889.1 ± 3.7

Downloads