imagining syntax

← schedopt_bo_r8

r8_c1

done · peak unseen_mismatch 95.8

α schedule

α 3.4651 ×25 α 3.464 ×25 α 3.4579 ×25 α 0.9384 ×25 α 0.9288 ×25 α 3.3433 ×25 α 3.2438 ×25 α 3.0962 ×25 α 0.7877 ×25 α 0.7109 ×25 α 0.6104 ×25 α 1.7673 ×25 α 1.1785 ×25 α 0.1241 ×25

direction
mixed
α range
0.1241–3.4651
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.1241

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.450.3 ± 1.650.0 ± 1.549.4 ± 1.7
50 51.3 ± 1.450.3 ± 1.549.9 ± 1.250.0 ± 1.8
75 52.5 ± 2.050.0 ± 1.650.7 ± 1.549.6 ± 1.6
100 53.8 ± 5.250.9 ± 1.651.8 ± 3.449.9 ± 1.7
125 60.6 ± 13.350.5 ± 2.757.9 ± 13.249.4 ± 3.2
150 72.7 ± 19.261.3 ± 12.370.2 ± 19.458.8 ± 11.0
175 83.6 ± 16.374.8 ± 15.480.6 ± 17.171.5 ± 15.2
200 89.9 ± 10.986.2 ± 10.386.3 ± 12.380.7 ± 11.9
225 98.7 ± 3.189.2 ± 17.198.5 ± 3.388.3 ± 16.6
250 100.0 ± 0.083.3 ± 21.499.9 ± 0.382.7 ± 21.3
275 100.0 ± 0.083.5 ± 19.8100.0 ± 0.082.9 ± 19.9
300 99.9 ± 0.593.9 ± 9.499.5 ± 1.992.1 ± 9.5
325 99.9 ± 0.396.8 ± 9.499.8 ± 0.595.8 ± 9.0
350 100.0 ± 0.090.4 ± 17.6100.0 ± 0.089.3 ± 18.0

Downloads