imagining syntax

← mirror_v1

s0_e2

done · peak unseen_mismatch 91.0

α schedule

α 0.0 ×50 α 0.087 ×50 α 0.1739 ×50 α 0.2609 ×50 α 0.3478 ×50 α 0.4348 ×50 α 0.5217 ×50 α 0.6087 ×50 α 0.6957 ×50 α 0.7826 ×50 α 0.8696 ×50 α 0.9565 ×50 α 1.0435 ×50 α 1.1304 ×50 α 1.2174 ×50 α 1.3043 ×50 α 1.3913 ×50 α 1.4783 ×50 α 1.5652 ×50 α 1.6522 ×50 α 1.7391 ×50 α 1.8261 ×50 α 1.913 ×50 α 2.0 ×50

direction
ascending
α range
0.0–2.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.4 ± 1.649.9 ± 1.149.8 ± 1.949.6 ± 1.9
100 50.2 ± 1.250.0 ± 1.749.6 ± 1.249.4 ± 1.2
150 50.5 ± 3.549.0 ± 2.950.5 ± 3.548.8 ± 2.8
200 61.2 ± 18.643.8 ± 13.160.1 ± 19.244.0 ± 13.1
250 65.5 ± 21.240.3 ± 16.665.4 ± 21.240.2 ± 16.3
300 72.8 ± 23.238.1 ± 14.572.8 ± 23.040.0 ± 15.1
350 87.5 ± 19.829.9 ± 21.286.8 ± 20.629.8 ± 20.8
400 90.6 ± 18.832.1 ± 22.990.6 ± 18.833.3 ± 23.8
450 95.2 ± 14.331.6 ± 25.695.2 ± 14.332.3 ± 25.8
500 99.6 ± 1.225.7 ± 30.899.5 ± 1.625.6 ± 30.7
550 100.0 ± 0.029.3 ± 33.5100.0 ± 0.029.1 ± 33.2
600 100.0 ± 0.028.8 ± 25.9100.0 ± 0.028.9 ± 25.7
650 100.0 ± 0.029.8 ± 27.5100.0 ± 0.030.0 ± 28.3
700 100.0 ± 0.026.2 ± 25.4100.0 ± 0.026.7 ± 25.5
750 100.0 ± 0.035.1 ± 22.4100.0 ± 0.035.4 ± 22.7
800 100.0 ± 0.043.5 ± 24.1100.0 ± 0.043.4 ± 24.6
850 100.0 ± 0.046.2 ± 25.8100.0 ± 0.046.6 ± 25.4
900 100.0 ± 0.059.1 ± 25.4100.0 ± 0.058.6 ± 24.6
950 100.0 ± 0.071.3 ± 30.9100.0 ± 0.070.8 ± 30.3
1000 100.0 ± 0.072.8 ± 26.8100.0 ± 0.072.8 ± 26.1
1050 99.9 ± 0.282.1 ± 27.499.8 ± 0.481.2 ± 26.6
1100 99.7 ± 0.491.1 ± 14.899.0 ± 1.489.8 ± 14.8
1150 99.4 ± 0.892.8 ± 11.698.6 ± 1.991.0 ± 10.6
1200 98.9 ± 1.292.5 ± 11.697.6 ± 2.490.0 ± 11.2

Downloads