imagining syntax

← deform_v1

v_1.3

done · peak unseen_mismatch 92.5

Referenced by

α schedule

α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 3.0 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 2.1429 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.3 ×19 α 1.2857 ×19 α 1.2857 ×19 α 1.2857 ×19 α 1.2857 ×19 α 1.2857 ×18 α 1.2857 ×18 α 1.2857 ×18 α 1.2857 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18 α 1.3 ×18

direction
mixed
α range
1.2857–3.0
stages
48

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.3

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.4 ± 1.549.5 ± 1.649.8 ± 1.949.7 ± 2.1
50 50.7 ± 1.949.6 ± 1.450.1 ± 1.550.8 ± 1.1
75 51.9 ± 1.850.1 ± 1.950.5 ± 1.750.0 ± 1.9
100 53.8 ± 2.952.1 ± 2.951.5 ± 1.850.0 ± 1.5
125 65.8 ± 10.560.5 ± 8.159.9 ± 9.254.9 ± 5.3
150 79.3 ± 12.473.6 ± 12.872.2 ± 14.166.3 ± 12.7
175 91.2 ± 12.583.1 ± 16.187.6 ± 14.177.9 ± 16.2
200 96.7 ± 10.787.3 ± 17.895.8 ± 10.484.5 ± 17.6
225 97.1 ± 11.190.3 ± 16.496.2 ± 10.987.8 ± 15.9
250 97.2 ± 10.891.1 ± 20.196.6 ± 10.187.8 ± 19.3
275 97.3 ± 10.293.1 ± 14.396.6 ± 10.889.6 ± 13.7
300 98.6 ± 5.294.4 ± 12.397.3 ± 5.890.2 ± 12.7
325 98.4 ± 1.194.6 ± 8.494.9 ± 4.387.7 ± 9.9
350 97.8 ± 1.396.3 ± 2.293.2 ± 4.988.2 ± 7.0
375 97.6 ± 1.295.9 ± 1.892.6 ± 3.987.4 ± 5.8
400 97.4 ± 1.295.6 ± 1.991.0 ± 4.685.3 ± 6.6
450 96.8 ± 1.295.2 ± 1.690.0 ± 4.084.4 ± 5.7
500 99.4 ± 0.598.5 ± 0.997.2 ± 1.892.5 ± 5.0
550 99.7 ± 0.298.5 ± 1.297.6 ± 1.692.2 ± 4.3
600 99.7 ± 0.298.3 ± 1.697.6 ± 1.089.5 ± 8.2
650 99.8 ± 0.298.5 ± 1.097.3 ± 1.890.1 ± 6.5
700 99.8 ± 0.398.5 ± 1.397.7 ± 1.788.2 ± 7.5
750 99.9 ± 0.198.7 ± 1.197.9 ± 1.589.0 ± 7.2
800 99.8 ± 0.298.4 ± 1.498.0 ± 1.288.4 ± 7.6
850 99.8 ± 0.298.5 ± 1.197.0 ± 1.787.7 ± 5.3
900 99.8 ± 0.198.3 ± 1.397.4 ± 1.585.8 ± 8.2

Downloads