imagining syntax

← mirror_v1

s5_e3_blk

done · peak unseen_mismatch 74.1

α schedule

α 5.0 ×400 α 4.0 ×400 α 3.0 ×400

direction
descending
α range
3.0–5.0
stages
3

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 59.6 ± 6.456.9 ± 4.652.8 ± 3.751.7 ± 3.0
150 76.5 ± 5.574.3 ± 5.662.2 ± 5.959.1 ± 4.4
200 79.5 ± 1.978.0 ± 2.060.5 ± 3.559.9 ± 3.0
250 79.8 ± 1.878.6 ± 1.660.5 ± 3.159.4 ± 3.1
300 82.4 ± 1.681.0 ± 1.863.4 ± 3.662.4 ± 3.8
350 83.8 ± 2.382.1 ± 2.265.8 ± 5.665.2 ± 5.9
400 83.3 ± 1.781.8 ± 1.564.7 ± 2.362.0 ± 3.1
450 86.4 ± 1.284.3 ± 2.167.8 ± 5.264.1 ± 4.5
500 86.3 ± 1.984.5 ± 2.367.3 ± 4.064.2 ± 3.8
550 87.2 ± 1.885.6 ± 2.268.5 ± 6.264.1 ± 6.3
600 87.5 ± 1.986.1 ± 2.168.7 ± 4.164.6 ± 3.9
650 88.4 ± 1.786.6 ± 1.768.9 ± 4.264.7 ± 4.4
700 88.5 ± 1.486.5 ± 1.469.2 ± 3.264.8 ± 2.5
750 88.4 ± 1.386.5 ± 1.469.8 ± 3.065.4 ± 2.3
800 88.8 ± 1.587.2 ± 1.471.0 ± 3.166.1 ± 2.8
850 92.2 ± 1.190.1 ± 1.777.2 ± 3.671.3 ± 4.4
900 92.0 ± 1.590.2 ± 1.974.9 ± 5.570.3 ± 6.0
950 93.0 ± 1.290.8 ± 1.377.6 ± 4.871.3 ± 6.2
1000 93.3 ± 1.191.6 ± 1.078.8 ± 4.072.6 ± 4.9
1050 93.1 ± 1.491.0 ± 1.577.4 ± 3.371.8 ± 4.0
1100 93.6 ± 0.992.1 ± 1.379.3 ± 4.873.9 ± 4.9
1150 93.9 ± 1.391.8 ± 1.479.1 ± 4.074.1 ± 5.2
1200 93.7 ± 1.192.4 ± 0.979.8 ± 3.874.1 ± 3.3

Downloads