imagining syntax

← schedopt_bo_r2

r2_c5

done · peak unseen_mismatch 91.2

α schedule

α 1.5358 ×25 α 1.5359 ×25 α 1.5365 ×25 α 1.5383 ×25 α 1.5425 ×25 α 1.5505 ×25 α 1.5639 ×25 α 1.5849 ×25 α 1.6157 ×25 α 1.659 ×25 α 1.7178 ×25 α 1.7952 ×25 α 1.8947 ×25 α 2.0202 ×25 α 2.1758 ×25 α 2.3656 ×25

direction
ascending
α range
1.5358–2.3656
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.3656

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.5 ± 1.650.2 ± 1.449.8 ± 1.549.4 ± 2.1
50 50.6 ± 1.850.0 ± 1.650.2 ± 1.549.8 ± 1.8
75 50.4 ± 1.449.5 ± 1.750.3 ± 1.249.4 ± 1.7
100 50.2 ± 2.250.0 ± 1.550.2 ± 1.650.0 ± 1.5
125 51.9 ± 2.549.0 ± 2.051.0 ± 2.848.9 ± 2.4
150 55.2 ± 10.449.8 ± 3.754.3 ± 10.348.7 ± 4.4
175 62.8 ± 17.248.3 ± 8.162.0 ± 17.448.4 ± 7.6
200 72.6 ± 22.851.5 ± 14.772.4 ± 22.851.1 ± 13.6
225 76.9 ± 23.952.5 ± 17.076.9 ± 23.752.5 ± 16.2
250 78.9 ± 22.753.5 ± 19.278.4 ± 23.053.1 ± 18.8
275 85.5 ± 20.566.7 ± 21.584.7 ± 21.265.4 ± 20.7
300 91.4 ± 15.571.5 ± 24.591.0 ± 15.870.5 ± 24.0
325 96.7 ± 10.180.5 ± 23.096.4 ± 10.979.5 ± 23.2
350 98.8 ± 5.185.5 ± 18.798.5 ± 6.084.8 ± 18.2
375 99.7 ± 0.589.1 ± 16.499.4 ± 1.088.3 ± 15.1
400 99.4 ± 0.792.8 ± 11.398.7 ± 1.791.2 ± 10.5

Downloads