imagining syntax

← mirror_v1

s4_e4

done · peak unseen_mismatch 69.8

α schedule

α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50 α 4.0 ×50

direction
constant
α range
4.0–4.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.6 ± 8.456.8 ± 7.154.0 ± 5.352.7 ± 4.4
150 77.6 ± 5.576.5 ± 5.564.2 ± 5.961.6 ± 6.1
200 82.4 ± 1.581.0 ± 1.466.1 ± 3.063.7 ± 3.6
250 85.1 ± 2.383.2 ± 2.067.0 ± 4.765.2 ± 3.5
300 87.0 ± 1.185.6 ± 1.269.6 ± 3.466.6 ± 3.9
350 88.2 ± 1.986.1 ± 1.670.2 ± 4.067.7 ± 5.0
400 87.8 ± 2.085.6 ± 1.970.0 ± 4.066.0 ± 3.7
450 88.2 ± 1.586.0 ± 2.070.5 ± 4.267.0 ± 4.8
500 89.5 ± 1.287.4 ± 1.872.1 ± 1.667.2 ± 3.1
550 89.0 ± 1.987.3 ± 2.271.6 ± 4.268.0 ± 4.5
600 89.2 ± 2.187.3 ± 2.071.7 ± 3.867.1 ± 2.8
650 89.9 ± 1.787.7 ± 1.172.4 ± 3.767.0 ± 3.1
700 89.1 ± 1.086.9 ± 1.971.3 ± 3.266.2 ± 3.2
750 89.8 ± 1.087.3 ± 1.273.7 ± 2.768.0 ± 3.5
800 89.2 ± 1.686.5 ± 1.470.9 ± 3.765.5 ± 3.8
850 90.2 ± 0.988.1 ± 1.572.4 ± 3.367.4 ± 4.1
900 90.4 ± 1.488.0 ± 1.473.7 ± 2.268.3 ± 3.0
950 90.5 ± 1.587.8 ± 0.774.1 ± 3.268.7 ± 3.1
1000 90.6 ± 1.788.5 ± 1.573.8 ± 2.269.0 ± 2.4
1050 90.6 ± 0.888.2 ± 1.774.3 ± 3.368.3 ± 4.5
1100 90.9 ± 1.388.2 ± 1.674.8 ± 3.568.5 ± 4.4
1150 90.9 ± 1.288.3 ± 1.375.8 ± 2.868.7 ± 4.1
1200 91.1 ± 1.088.4 ± 1.275.0 ± 3.069.8 ± 3.6

Downloads