imagining syntax

← mirror_v1

s4_e0_blk

done · peak unseen_mismatch 98.2

α schedule

α 4.0 ×240 α 3.0 ×240 α 2.0 ×240 α 1.0 ×240 α 0.0 ×240

direction
descending
α range
0.0–4.0
stages
5

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.7 ± 7.356.1 ± 6.152.6 ± 4.251.5 ± 2.9
150 76.9 ± 6.375.5 ± 5.265.1 ± 6.561.0 ± 5.8
200 82.0 ± 2.580.4 ± 1.764.6 ± 3.863.1 ± 3.1
250 84.5 ± 1.983.2 ± 2.265.7 ± 4.363.5 ± 3.4
300 89.2 ± 1.687.7 ± 1.271.1 ± 5.269.3 ± 4.4
350 91.3 ± 1.589.7 ± 2.075.7 ± 4.373.4 ± 4.9
400 91.6 ± 1.490.1 ± 1.674.8 ± 4.670.3 ± 3.8
450 91.7 ± 1.189.8 ± 1.575.7 ± 4.270.6 ± 4.3
500 96.8 ± 1.195.5 ± 1.187.2 ± 2.782.4 ± 2.3
550 96.6 ± 0.895.1 ± 1.484.9 ± 3.478.3 ± 5.6
600 97.1 ± 0.895.6 ± 0.987.4 ± 2.981.6 ± 3.3
650 97.6 ± 0.596.1 ± 1.289.2 ± 1.782.7 ± 4.5
700 97.8 ± 1.096.2 ± 1.588.7 ± 4.382.5 ± 6.3
750 100.0 ± 0.099.8 ± 0.399.8 ± 0.498.2 ± 2.8
800 100.0 ± 0.099.5 ± 0.799.2 ± 0.694.5 ± 4.2
850 100.0 ± 0.199.6 ± 0.699.0 ± 1.293.3 ± 5.6
900 100.0 ± 0.099.6 ± 0.699.2 ± 0.793.7 ± 6.0
950 100.0 ± 0.099.5 ± 0.598.6 ± 1.492.6 ± 6.7
1000 100.0 ± 0.068.0 ± 32.9100.0 ± 0.065.8 ± 33.2
1050 100.0 ± 0.047.0 ± 29.1100.0 ± 0.045.6 ± 29.4
1100 100.0 ± 0.030.3 ± 34.8100.0 ± 0.029.5 ± 34.2
1150 100.0 ± 0.022.6 ± 17.999.4 ± 1.027.8 ± 17.4
1200 100.0 ± 0.015.3 ± 16.999.8 ± 0.318.7 ± 16.2

Downloads