imagining syntax

← mirror_v1

s4_e1_blk

done · peak unseen_mismatch 96.8

α schedule

α 4.0 ×300 α 3.0 ×300 α 2.0 ×300 α 1.0 ×300

direction
descending
α range
1.0–4.0
stages
4

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.7 ± 7.356.1 ± 6.152.6 ± 4.251.5 ± 2.9
150 76.9 ± 6.375.5 ± 5.265.1 ± 6.561.0 ± 5.8
200 82.0 ± 2.580.4 ± 1.764.6 ± 3.863.1 ± 3.1
250 83.9 ± 2.082.2 ± 2.064.0 ± 4.262.4 ± 3.2
300 85.9 ± 1.684.5 ± 2.267.5 ± 4.966.6 ± 4.4
350 90.9 ± 1.989.1 ± 1.575.6 ± 4.272.6 ± 4.4
400 90.6 ± 1.288.2 ± 1.873.2 ± 4.668.8 ± 3.2
450 91.4 ± 1.589.9 ± 1.773.5 ± 5.869.2 ± 5.6
500 91.8 ± 1.489.7 ± 1.775.5 ± 4.770.3 ± 4.8
550 92.0 ± 1.290.9 ± 1.876.5 ± 3.071.6 ± 4.2
600 92.4 ± 1.390.7 ± 1.975.9 ± 3.371.0 ± 4.7
650 96.4 ± 1.394.5 ± 1.584.2 ± 3.777.1 ± 5.2
700 97.6 ± 0.896.1 ± 0.887.5 ± 3.680.0 ± 4.7
750 97.5 ± 0.896.2 ± 0.888.3 ± 3.081.4 ± 3.4
800 98.3 ± 0.596.7 ± 1.089.9 ± 2.982.1 ± 3.3
850 98.2 ± 0.696.6 ± 0.990.2 ± 3.483.5 ± 4.7
900 98.2 ± 0.496.5 ± 0.990.3 ± 2.482.2 ± 3.6
950 100.0 ± 0.199.7 ± 0.499.4 ± 0.695.6 ± 3.6
1000 100.0 ± 0.099.8 ± 0.299.5 ± 0.596.8 ± 2.2
1050 100.0 ± 0.099.6 ± 0.399.4 ± 0.494.0 ± 3.8
1100 100.0 ± 0.099.8 ± 0.399.3 ± 0.795.0 ± 3.1
1150 100.0 ± 0.198.8 ± 1.499.1 ± 0.988.4 ± 11.0
1200 100.0 ± 0.199.3 ± 0.899.0 ± 1.289.6 ± 10.9

Downloads