imagining syntax

← mirror_v1

s0_e1

done · peak unseen_mismatch 49.7

α schedule

α 0.0 ×50 α 0.0435 ×50 α 0.087 ×50 α 0.1304 ×50 α 0.1739 ×50 α 0.2174 ×50 α 0.2609 ×50 α 0.3043 ×50 α 0.3478 ×50 α 0.3913 ×50 α 0.4348 ×50 α 0.4783 ×50 α 0.5217 ×50 α 0.5652 ×50 α 0.6087 ×50 α 0.6522 ×50 α 0.6957 ×50 α 0.7391 ×50 α 0.7826 ×50 α 0.8261 ×50 α 0.8696 ×50 α 0.913 ×50 α 0.9565 ×50 α 1.0 ×50

direction
ascending
α range
0.0–1.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.4 ± 1.649.9 ± 1.149.8 ± 1.949.6 ± 1.9
100 50.2 ± 1.450.0 ± 2.049.6 ± 1.149.7 ± 1.1
150 49.4 ± 2.249.5 ± 1.850.2 ± 1.448.5 ± 1.6
200 57.6 ± 10.445.8 ± 7.056.7 ± 11.445.5 ± 6.9
250 65.4 ± 22.547.1 ± 10.965.3 ± 22.446.8 ± 10.7
300 72.0 ± 23.137.5 ± 16.971.4 ± 23.438.7 ± 17.9
350 81.7 ± 22.535.5 ± 17.480.9 ± 23.535.9 ± 17.4
400 98.2 ± 5.319.3 ± 17.398.0 ± 6.120.1 ± 17.7
450 100.0 ± 0.032.2 ± 24.1100.0 ± 0.132.0 ± 23.4
500 100.0 ± 0.019.5 ± 18.9100.0 ± 0.019.9 ± 19.8
550 100.0 ± 0.032.1 ± 35.2100.0 ± 0.032.2 ± 35.4
600 100.0 ± 0.012.7 ± 18.3100.0 ± 0.013.3 ± 19.0
650 100.0 ± 0.017.5 ± 20.6100.0 ± 0.017.8 ± 21.2
700 100.0 ± 0.023.0 ± 25.1100.0 ± 0.023.6 ± 26.2
750 100.0 ± 0.022.2 ± 21.7100.0 ± 0.022.3 ± 21.6
800 100.0 ± 0.020.6 ± 23.5100.0 ± 0.021.6 ± 24.3
850 100.0 ± 0.021.5 ± 23.4100.0 ± 0.021.9 ± 23.3
900 100.0 ± 0.025.7 ± 25.0100.0 ± 0.025.6 ± 23.3
950 100.0 ± 0.039.1 ± 29.5100.0 ± 0.039.2 ± 29.5
1000 100.0 ± 0.032.4 ± 31.3100.0 ± 0.032.8 ± 31.7
1050 100.0 ± 0.035.4 ± 30.0100.0 ± 0.036.0 ± 30.1
1100 100.0 ± 0.027.9 ± 23.3100.0 ± 0.028.2 ± 22.9
1150 100.0 ± 0.033.8 ± 27.6100.0 ± 0.032.6 ± 26.8
1200 100.0 ± 0.021.3 ± 20.7100.0 ± 0.021.4 ± 20.9

Downloads