imagining syntax

← mirror_v1

s5_e2_blk

done · peak unseen_mismatch 82.3

α schedule

α 5.0 ×300 α 4.0 ×300 α 3.0 ×300 α 2.0 ×300

direction
descending
α range
2.0–5.0
stages
4

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 59.6 ± 6.456.9 ± 4.652.8 ± 3.751.7 ± 3.0
150 76.5 ± 5.574.3 ± 5.662.2 ± 5.959.1 ± 4.4
200 79.5 ± 1.978.0 ± 2.060.5 ± 3.559.9 ± 3.0
250 79.8 ± 1.878.6 ± 1.660.5 ± 3.159.4 ± 3.1
300 82.4 ± 1.681.0 ± 1.863.4 ± 3.662.4 ± 3.8
350 85.8 ± 3.184.5 ± 2.767.5 ± 5.865.3 ± 5.9
400 86.0 ± 1.483.8 ± 1.966.4 ± 3.163.3 ± 4.6
450 86.4 ± 2.085.3 ± 2.067.0 ± 5.264.4 ± 5.3
500 87.3 ± 2.185.8 ± 2.067.0 ± 4.664.0 ± 4.1
550 88.3 ± 1.485.9 ± 1.970.4 ± 3.765.8 ± 5.0
600 88.2 ± 2.186.0 ± 2.169.0 ± 4.864.5 ± 5.2
650 90.9 ± 1.288.4 ± 1.673.0 ± 2.968.6 ± 4.3
700 91.9 ± 1.489.5 ± 1.874.3 ± 5.168.2 ± 6.4
750 92.6 ± 1.390.8 ± 1.576.3 ± 4.670.6 ± 5.3
800 92.6 ± 1.190.7 ± 1.477.0 ± 3.871.3 ± 4.6
850 92.5 ± 1.290.5 ± 1.376.5 ± 3.670.6 ± 4.8
900 93.3 ± 1.291.4 ± 1.378.5 ± 4.172.3 ± 5.0
950 97.0 ± 0.995.9 ± 1.686.1 ± 4.278.8 ± 7.3
1000 98.0 ± 0.996.4 ± 1.590.1 ± 3.982.0 ± 6.8
1050 97.9 ± 0.396.1 ± 1.489.5 ± 2.781.1 ± 6.4
1100 98.4 ± 0.696.9 ± 0.990.7 ± 4.181.9 ± 5.3
1150 98.2 ± 0.796.3 ± 2.190.6 ± 3.681.5 ± 9.0
1200 98.5 ± 0.796.9 ± 1.391.0 ± 2.982.3 ± 7.2

Downloads