imagining syntax

← mirror_v1

s2_e0_blk

done · peak unseen_mismatch 99.3

α schedule

α 2.0 ×400 α 1.0 ×400 α 0.0 ×400

direction
descending
α range
0.0–2.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.5 ± 1.949.9 ± 0.550.1 ± 1.950.1 ± 1.5
100 51.8 ± 1.750.8 ± 1.950.5 ± 1.750.4 ± 1.9
150 63.7 ± 13.655.5 ± 7.262.4 ± 12.652.6 ± 6.4
200 80.6 ± 21.267.9 ± 17.079.9 ± 21.966.8 ± 15.8
250 96.6 ± 6.591.5 ± 8.495.5 ± 8.688.7 ± 10.9
300 99.3 ± 0.798.5 ± 0.998.6 ± 1.696.5 ± 1.9
350 98.8 ± 0.897.6 ± 1.596.5 ± 2.194.1 ± 3.4
400 98.3 ± 1.097.5 ± 1.494.8 ± 2.592.0 ± 4.4
450 100.0 ± 0.099.8 ± 0.299.7 ± 0.399.3 ± 0.8
500 99.9 ± 0.199.7 ± 0.399.7 ± 0.498.7 ± 1.1
550 100.0 ± 0.099.5 ± 0.699.7 ± 0.796.9 ± 4.5
600 100.0 ± 0.099.3 ± 1.799.9 ± 0.197.4 ± 4.3
650 99.9 ± 0.199.5 ± 0.599.6 ± 0.597.0 ± 2.6
700 100.0 ± 0.099.6 ± 0.499.5 ± 0.696.4 ± 2.4
750 100.0 ± 0.199.3 ± 0.899.3 ± 0.895.8 ± 4.0
800 100.0 ± 0.099.0 ± 1.099.5 ± 0.595.0 ± 3.5
850 100.0 ± 0.066.2 ± 32.2100.0 ± 0.065.2 ± 31.0
900 100.0 ± 0.037.1 ± 30.8100.0 ± 0.137.6 ± 29.2
950 100.0 ± 0.028.8 ± 26.8100.0 ± 0.029.0 ± 25.3
1000 100.0 ± 0.013.1 ± 12.0100.0 ± 0.116.4 ± 13.3
1050 100.0 ± 0.019.2 ± 9.399.8 ± 0.225.2 ± 12.3
1100 100.0 ± 0.021.1 ± 13.399.6 ± 0.528.0 ± 14.0
1150 100.0 ± 0.012.2 ± 10.199.6 ± 0.917.9 ± 13.0
1200 100.0 ± 0.015.6 ± 14.299.9 ± 0.221.4 ± 15.8

Downloads