imagining syntax

← schedopt_design

p02

done · peak unseen_mismatch 78.2

α schedule

α 2.133 ×25 α 2.2502 ×25 α 2.367 ×25 α 2.4835 ×25 α 2.5999 ×25 α 2.7162 ×25 α 2.8324 ×25 α 2.9484 ×25 α 3.0644 ×25 α 3.1804 ×25 α 3.2963 ×25 α 3.4121 ×25 α 3.5278 ×25 α 3.6436 ×25 α 3.7593 ×25 α 3.8749 ×25

direction
ascending
α range
2.133–3.8749
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.8749

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.450.1 ± 1.850.0 ± 1.649.5 ± 1.8
50 51.0 ± 1.550.3 ± 1.649.8 ± 1.450.0 ± 1.6
75 51.1 ± 1.649.6 ± 1.650.3 ± 1.449.6 ± 1.5
100 52.1 ± 3.450.6 ± 1.450.9 ± 2.149.9 ± 1.6
125 58.4 ± 10.052.5 ± 5.254.7 ± 8.750.2 ± 3.6
150 66.8 ± 16.361.8 ± 12.563.5 ± 16.057.2 ± 11.0
175 78.0 ± 17.072.6 ± 16.072.5 ± 18.467.0 ± 15.1
200 83.5 ± 13.880.1 ± 13.775.7 ± 16.371.7 ± 14.9
225 89.6 ± 7.686.5 ± 7.581.3 ± 11.077.4 ± 10.4
250 91.3 ± 4.689.2 ± 4.481.2 ± 8.977.7 ± 8.0
275 92.0 ± 3.789.9 ± 3.681.6 ± 8.178.2 ± 7.6
300 91.8 ± 3.389.5 ± 3.079.9 ± 7.876.4 ± 7.3
325 90.8 ± 2.788.7 ± 2.678.3 ± 6.975.0 ± 6.3
350 90.7 ± 2.588.5 ± 2.377.8 ± 5.574.1 ± 5.3
375 90.5 ± 2.188.2 ± 2.076.5 ± 4.872.8 ± 4.2
400 90.1 ± 1.887.8 ± 1.675.4 ± 4.272.0 ± 3.0

Downloads