imagining syntax

← mirror_v1

s4_e1

done · peak unseen_mismatch 93.7

α schedule

α 4.0 ×50 α 3.8696 ×50 α 3.7391 ×50 α 3.6087 ×50 α 3.4783 ×50 α 3.3478 ×50 α 3.2174 ×50 α 3.087 ×50 α 2.9565 ×50 α 2.8261 ×50 α 2.6957 ×50 α 2.5652 ×50 α 2.4348 ×50 α 2.3043 ×50 α 2.1739 ×50 α 2.0435 ×50 α 1.913 ×50 α 1.7826 ×50 α 1.6522 ×50 α 1.5217 ×50 α 1.3913 ×50 α 1.2609 ×50 α 1.1304 ×50 α 1.0 ×50

direction
descending
α range
1.0–4.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.7 ± 1.949.6 ± 1.049.9 ± 2.150.5 ± 1.2
100 58.5 ± 8.556.3 ± 6.754.2 ± 5.753.0 ± 4.2
150 77.8 ± 6.976.9 ± 6.265.6 ± 7.062.0 ± 6.6
200 83.7 ± 2.081.9 ± 1.967.7 ± 3.764.5 ± 3.5
250 86.7 ± 2.184.7 ± 1.969.2 ± 5.367.3 ± 3.4
300 89.5 ± 1.987.9 ± 1.773.0 ± 3.370.3 ± 4.1
350 90.2 ± 2.388.7 ± 2.674.0 ± 5.670.7 ± 4.5
400 91.0 ± 2.188.9 ± 1.974.2 ± 5.570.0 ± 4.6
450 92.7 ± 1.090.5 ± 1.777.8 ± 4.672.3 ± 4.6
500 93.4 ± 1.191.9 ± 1.077.8 ± 2.373.0 ± 2.6
550 94.2 ± 1.092.2 ± 1.280.3 ± 3.175.7 ± 3.7
600 95.0 ± 1.093.0 ± 1.682.1 ± 3.775.9 ± 5.2
650 95.9 ± 1.193.9 ± 1.083.2 ± 4.077.7 ± 4.0
700 96.4 ± 0.794.7 ± 1.284.6 ± 2.378.4 ± 4.1
750 97.2 ± 0.794.9 ± 1.587.2 ± 3.479.0 ± 5.6
800 97.7 ± 1.096.0 ± 1.588.2 ± 4.281.6 ± 5.6
850 98.1 ± 0.496.7 ± 1.191.2 ± 2.384.6 ± 4.1
900 99.0 ± 0.397.8 ± 1.093.3 ± 1.586.1 ± 4.8
950 99.2 ± 0.598.0 ± 0.894.3 ± 3.285.8 ± 6.4
1000 99.5 ± 0.398.5 ± 0.696.0 ± 1.989.2 ± 3.9
1050 99.8 ± 0.299.2 ± 0.997.4 ± 1.189.7 ± 6.5
1100 99.9 ± 0.199.0 ± 0.897.6 ± 1.290.9 ± 4.1
1150 100.0 ± 0.099.6 ± 0.499.5 ± 0.393.7 ± 4.7
1200 100.0 ± 0.099.3 ± 1.199.5 ± 0.491.6 ± 9.3

Downloads