imagining syntax

← mirror_v1

s0_e3

done · peak unseen_mismatch 86.8

α schedule

α 0.0 ×50 α 0.1304 ×50 α 0.2609 ×50 α 0.3913 ×50 α 0.5217 ×50 α 0.6522 ×50 α 0.7826 ×50 α 0.913 ×50 α 1.0435 ×50 α 1.1739 ×50 α 1.3043 ×50 α 1.4348 ×50 α 1.5652 ×50 α 1.6957 ×50 α 1.8261 ×50 α 1.9565 ×50 α 2.087 ×50 α 2.2174 ×50 α 2.3478 ×50 α 2.4783 ×50 α 2.6087 ×50 α 2.7391 ×50 α 2.8696 ×50 α 3.0 ×50

direction
ascending
α range
0.0–3.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 50.4 ± 1.649.9 ± 1.149.8 ± 1.949.6 ± 1.9
100 50.5 ± 1.550.2 ± 1.749.8 ± 1.449.6 ± 1.0
150 50.1 ± 1.849.6 ± 2.150.1 ± 2.548.9 ± 1.8
200 60.8 ± 17.044.4 ± 8.460.3 ± 17.244.3 ± 8.4
250 70.2 ± 23.338.3 ± 17.869.8 ± 23.738.6 ± 17.9
300 76.9 ± 23.228.9 ± 21.076.4 ± 23.730.6 ± 22.3
350 83.3 ± 21.923.8 ± 21.083.0 ± 22.123.3 ± 20.4
400 91.7 ± 17.019.7 ± 19.391.7 ± 16.919.8 ± 19.0
450 95.1 ± 14.819.9 ± 18.895.4 ± 13.920.4 ± 19.2
500 95.9 ± 12.314.3 ± 12.695.8 ± 12.713.9 ± 12.1
550 100.0 ± 0.023.6 ± 25.8100.0 ± 0.023.9 ± 26.3
600 100.0 ± 0.028.7 ± 16.4100.0 ± 0.028.5 ± 16.4
650 100.0 ± 0.027.4 ± 30.2100.0 ± 0.027.2 ± 30.1
700 100.0 ± 0.036.0 ± 30.0100.0 ± 0.036.1 ± 29.7
750 100.0 ± 0.056.2 ± 33.1100.0 ± 0.055.9 ± 33.0
800 100.0 ± 0.067.3 ± 30.7100.0 ± 0.066.6 ± 30.6
850 99.9 ± 0.176.6 ± 33.599.8 ± 0.575.7 ± 33.1
900 99.6 ± 0.685.0 ± 22.599.4 ± 0.982.7 ± 23.2
950 99.2 ± 0.787.8 ± 16.898.5 ± 1.385.5 ± 16.3
1000 98.6 ± 0.789.5 ± 24.296.5 ± 2.286.2 ± 22.9
1050 97.6 ± 1.290.9 ± 15.994.2 ± 3.186.8 ± 14.6
1100 96.7 ± 1.189.4 ± 16.891.5 ± 3.382.9 ± 15.4
1150 95.4 ± 1.592.2 ± 6.288.4 ± 4.383.9 ± 6.3
1200 94.2 ± 1.690.4 ± 6.585.5 ± 4.679.8 ± 7.2

Downloads