imagining syntax

← mirror_v1

s2_e2

done · peak unseen_mismatch 94.8

α schedule

α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50 α 2.0 ×50

direction
constant
α range
2.0–2.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.5 ± 1.949.9 ± 0.550.1 ± 1.950.1 ± 1.5
100 51.4 ± 2.250.6 ± 1.950.9 ± 1.848.9 ± 1.1
150 63.6 ± 17.258.1 ± 11.562.7 ± 16.456.0 ± 9.3
200 83.3 ± 19.977.6 ± 18.481.7 ± 20.774.7 ± 17.8
250 96.9 ± 7.393.9 ± 8.595.8 ± 8.491.1 ± 9.9
300 99.3 ± 0.898.0 ± 1.697.3 ± 2.894.8 ± 3.4
350 98.5 ± 1.296.9 ± 1.495.1 ± 4.291.5 ± 4.9
400 97.7 ± 1.195.9 ± 1.392.3 ± 4.488.1 ± 4.7
450 97.5 ± 0.795.7 ± 1.491.7 ± 2.987.5 ± 4.5
500 96.8 ± 0.595.5 ± 1.189.2 ± 1.885.3 ± 1.6
550 97.2 ± 0.995.8 ± 1.490.3 ± 2.986.2 ± 3.3
600 97.0 ± 1.195.3 ± 1.788.7 ± 3.484.1 ± 3.7
650 97.2 ± 0.895.4 ± 1.389.1 ± 2.883.5 ± 4.5
700 97.2 ± 1.195.6 ± 1.688.1 ± 3.884.0 ± 4.4
750 97.6 ± 0.995.8 ± 1.290.1 ± 3.384.8 ± 4.3
800 97.5 ± 0.895.7 ± 1.189.5 ± 3.284.6 ± 4.3
850 97.4 ± 1.096.0 ± 1.389.6 ± 5.084.9 ± 5.4
900 97.9 ± 1.196.7 ± 1.089.8 ± 3.585.4 ± 5.1
950 98.1 ± 0.696.2 ± 0.789.4 ± 3.685.2 ± 3.3
1000 97.9 ± 0.896.6 ± 0.989.7 ± 3.085.1 ± 3.0
1050 98.3 ± 0.496.8 ± 1.491.2 ± 2.886.2 ± 3.6
1100 98.3 ± 0.696.7 ± 1.090.9 ± 2.785.3 ± 3.5
1150 98.6 ± 0.697.2 ± 0.991.6 ± 2.086.9 ± 4.0
1200 98.2 ± 0.596.8 ± 0.790.9 ± 3.884.3 ± 4.7

Downloads