imagining syntax

← schedopt_design

p10

done · peak unseen_mismatch 93.1

α schedule

α 1.4187 ×25 α 1.4833 ×25 α 1.5508 ×25 α 1.6201 ×25 α 1.6905 ×25 α 1.762 ×25 α 1.8342 ×25 α 1.9071 ×25 α 1.9806 ×25 α 2.0547 ×25 α 2.1292 ×25 α 2.2041 ×25 α 2.2795 ×25 α 2.3552 ×25 α 2.4313 ×25 α 2.5076 ×25

direction
ascending
α range
1.4187–2.5076
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.5076

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.449.8 ± 1.549.7 ± 1.449.5 ± 1.5
50 50.5 ± 1.950.0 ± 1.649.9 ± 1.249.9 ± 1.4
75 50.7 ± 1.549.6 ± 1.750.1 ± 1.449.4 ± 1.6
100 50.7 ± 2.350.1 ± 1.550.4 ± 1.750.1 ± 1.6
125 52.4 ± 3.949.2 ± 2.451.6 ± 3.949.0 ± 2.5
150 56.8 ± 13.948.4 ± 7.155.6 ± 14.247.9 ± 7.0
175 62.1 ± 16.547.6 ± 9.261.6 ± 16.647.2 ± 8.7
200 74.4 ± 21.056.4 ± 13.973.2 ± 21.055.6 ± 13.7
225 81.0 ± 21.361.1 ± 18.680.1 ± 21.660.9 ± 17.9
250 86.3 ± 18.773.7 ± 18.685.0 ± 19.772.0 ± 18.0
275 92.8 ± 14.380.9 ± 18.291.7 ± 15.379.8 ± 18.0
300 95.1 ± 12.187.5 ± 15.194.0 ± 12.885.1 ± 15.6
325 97.9 ± 5.392.0 ± 10.896.9 ± 6.390.5 ± 10.6
350 99.0 ± 1.293.3 ± 12.197.8 ± 2.891.2 ± 11.7
375 98.6 ± 1.495.3 ± 8.796.4 ± 3.792.0 ± 8.7
400 98.2 ± 1.496.8 ± 1.795.7 ± 3.893.1 ± 3.8

Downloads