imagining syntax

← schedopt_design

p07

done · peak unseen_mismatch 91.1

α schedule

α 2.7685 ×25 α 2.607 ×25 α 2.4896 ×25 α 2.3913 ×25 α 2.3045 ×25 α 2.2257 ×25 α 2.1528 ×25 α 2.0846 ×25 α 2.0202 ×25 α 1.959 ×25 α 1.9005 ×25 α 1.8443 ×25 α 1.7902 ×25 α 1.7379 ×25 α 1.6872 ×25 α 1.6381 ×25

direction
descending
α range
1.6381–2.7685
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6381

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.0 ± 1.350.3 ± 1.750.1 ± 1.449.3 ± 1.9
50 51.1 ± 1.650.4 ± 1.849.9 ± 1.249.7 ± 1.7
75 51.4 ± 1.649.7 ± 1.650.3 ± 1.649.4 ± 1.7
100 53.7 ± 5.950.7 ± 1.852.1 ± 4.649.8 ± 1.6
125 63.2 ± 13.656.2 ± 8.358.9 ± 13.051.9 ± 5.8
150 72.9 ± 17.967.0 ± 14.868.9 ± 17.862.7 ± 13.0
175 83.1 ± 15.876.8 ± 14.778.0 ± 17.471.3 ± 14.5
200 90.7 ± 12.185.3 ± 12.185.9 ± 13.779.5 ± 13.2
225 96.2 ± 4.192.1 ± 5.491.8 ± 7.186.7 ± 7.2
250 97.6 ± 1.695.5 ± 2.693.6 ± 4.689.8 ± 6.0
275 98.3 ± 1.296.7 ± 1.994.1 ± 3.690.3 ± 5.2
300 98.1 ± 1.096.7 ± 1.694.1 ± 3.890.4 ± 5.2
325 98.2 ± 1.096.9 ± 1.793.6 ± 4.090.0 ± 5.9
350 98.3 ± 0.896.9 ± 1.293.5 ± 3.389.5 ± 4.5
375 98.5 ± 0.797.5 ± 0.994.1 ± 2.790.1 ± 3.5
400 98.7 ± 0.797.6 ± 1.195.1 ± 2.591.1 ± 3.2

Downloads