imagining syntax

← mirror_v1

s5_e1_blk

done · peak unseen_mismatch 95.7

α schedule

α 5.0 ×240 α 4.0 ×240 α 3.0 ×240 α 2.0 ×240 α 1.0 ×240

direction
descending
α range
1.0–5.0
stages
5

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 59.6 ± 6.456.9 ± 4.652.8 ± 3.751.7 ± 3.0
150 76.5 ± 5.574.3 ± 5.662.2 ± 5.959.1 ± 4.4
200 79.5 ± 1.978.0 ± 2.060.5 ± 3.559.9 ± 3.0
250 80.4 ± 2.079.1 ± 1.461.1 ± 3.559.2 ± 3.5
300 84.8 ± 1.683.3 ± 1.765.6 ± 4.964.4 ± 4.4
350 86.7 ± 2.385.3 ± 2.569.1 ± 5.267.1 ± 5.5
400 86.6 ± 1.285.4 ± 2.566.3 ± 4.063.7 ± 5.0
450 87.8 ± 1.386.1 ± 1.968.8 ± 3.964.7 ± 4.1
500 89.2 ± 2.087.0 ± 2.370.8 ± 4.366.4 ± 4.8
550 90.6 ± 1.688.4 ± 2.072.8 ± 3.967.4 ± 4.4
600 91.5 ± 1.389.1 ± 1.573.4 ± 5.268.3 ± 6.0
650 92.3 ± 1.589.8 ± 1.876.3 ± 4.069.7 ± 5.0
700 93.0 ± 1.091.3 ± 0.877.1 ± 3.172.0 ± 3.7
750 97.7 ± 0.896.1 ± 1.390.2 ± 4.083.0 ± 6.4
800 97.5 ± 0.995.9 ± 1.288.6 ± 3.080.9 ± 5.6
850 97.8 ± 0.896.1 ± 1.288.6 ± 3.180.7 ± 4.8
900 98.0 ± 0.996.0 ± 1.489.2 ± 3.081.5 ± 5.7
950 97.5 ± 0.895.7 ± 1.487.4 ± 4.580.1 ± 5.9
1000 100.0 ± 0.099.6 ± 0.499.7 ± 0.395.7 ± 3.1
1050 100.0 ± 0.099.4 ± 0.899.7 ± 0.593.8 ± 7.2
1100 100.0 ± 0.099.1 ± 1.399.8 ± 0.392.1 ± 5.9
1150 100.0 ± 0.099.3 ± 0.599.6 ± 0.391.9 ± 4.0
1200 100.0 ± 0.099.2 ± 0.599.0 ± 1.089.8 ± 6.4

Downloads