imagining syntax

← mirror_v1

s5_e1

done · peak unseen_mismatch 93.3

α schedule

α 5.0 ×50 α 4.8261 ×50 α 4.6522 ×50 α 4.4783 ×50 α 4.3043 ×50 α 4.1304 ×50 α 3.9565 ×50 α 3.7826 ×50 α 3.6087 ×50 α 3.4348 ×50 α 3.2609 ×50 α 3.087 ×50 α 2.913 ×50 α 2.7391 ×50 α 2.5652 ×50 α 2.3913 ×50 α 2.2174 ×50 α 2.0435 ×50 α 1.8696 ×50 α 1.6957 ×50 α 1.5217 ×50 α 1.3478 ×50 α 1.1739 ×50 α 1.0 ×50

direction
descending
α range
1.0–5.0
stages
24

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 60.2 ± 7.658.5 ± 7.154.0 ± 4.952.7 ± 4.2
150 76.0 ± 6.174.2 ± 6.062.1 ± 4.559.5 ± 4.3
200 80.3 ± 1.879.0 ± 1.363.8 ± 3.861.8 ± 3.0
250 83.0 ± 2.181.8 ± 1.864.2 ± 3.562.4 ± 2.9
300 84.7 ± 1.883.4 ± 1.966.0 ± 2.864.5 ± 2.7
350 88.7 ± 2.186.2 ± 3.071.2 ± 4.968.0 ± 5.4
400 87.1 ± 2.185.1 ± 2.168.5 ± 4.363.8 ± 5.5
450 89.4 ± 1.287.0 ± 1.671.4 ± 3.967.3 ± 5.8
500 90.5 ± 1.588.2 ± 1.872.5 ± 4.767.4 ± 5.6
550 90.7 ± 1.788.5 ± 2.073.2 ± 5.469.4 ± 5.1
600 92.0 ± 1.289.7 ± 1.375.0 ± 3.269.8 ± 4.7
650 93.4 ± 1.790.8 ± 1.678.5 ± 5.471.4 ± 6.2
700 93.4 ± 1.491.1 ± 2.077.7 ± 4.370.9 ± 4.6
750 94.7 ± 0.992.5 ± 1.781.6 ± 5.574.5 ± 7.9
800 95.6 ± 1.393.4 ± 1.784.3 ± 4.975.9 ± 6.1
850 96.8 ± 0.894.3 ± 1.587.7 ± 4.377.6 ± 5.2
900 97.9 ± 0.696.0 ± 1.487.8 ± 3.280.5 ± 5.3
950 98.1 ± 0.796.3 ± 1.491.4 ± 3.481.7 ± 5.2
1000 99.1 ± 0.497.1 ± 1.294.0 ± 1.882.4 ± 6.1
1050 99.5 ± 0.598.3 ± 0.995.8 ± 2.185.9 ± 5.9
1100 99.7 ± 0.298.2 ± 1.297.4 ± 0.886.8 ± 6.0
1150 100.0 ± 0.199.2 ± 0.899.5 ± 0.493.3 ± 5.1
1200 100.0 ± 0.099.0 ± 1.599.5 ± 0.491.2 ± 4.7

Downloads