imagining syntax

← schedopt_bo_r3

r3_c6

done · peak unseen_mismatch 91.6

α schedule

α 1.6368 ×25 α 1.6549 ×25 α 1.6848 ×25 α 1.7249 ×25 α 1.7742 ×25 α 1.8322 ×25 α 1.8982 ×25 α 1.9719 ×25 α 2.0531 ×25 α 2.1415 ×25 α 2.2368 ×25 α 2.3388 ×25 α 2.4474 ×25 α 2.5625 ×25 α 2.6839 ×25 α 2.8114 ×25

direction
ascending
α range
1.6368–2.8114
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.8114

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.6 ± 1.350.0 ± 1.649.8 ± 1.549.6 ± 1.9
50 50.8 ± 1.450.1 ± 1.649.8 ± 1.749.9 ± 1.3
75 50.7 ± 1.750.0 ± 1.750.4 ± 1.649.6 ± 1.7
100 50.8 ± 2.150.1 ± 1.550.2 ± 1.449.8 ± 1.8
125 52.7 ± 2.849.6 ± 2.051.6 ± 3.549.3 ± 2.3
150 57.7 ± 11.551.3 ± 3.755.6 ± 10.750.3 ± 3.2
175 67.5 ± 18.453.2 ± 9.566.3 ± 18.652.2 ± 10.0
200 78.8 ± 21.060.4 ± 15.078.0 ± 21.359.6 ± 14.4
225 84.6 ± 20.767.8 ± 17.783.5 ± 21.566.8 ± 17.1
250 89.2 ± 16.675.9 ± 22.587.6 ± 17.674.0 ± 22.7
275 94.4 ± 12.687.2 ± 15.593.2 ± 13.285.1 ± 15.5
300 96.2 ± 8.690.5 ± 12.194.7 ± 9.487.5 ± 12.2
325 97.9 ± 3.294.8 ± 7.195.8 ± 4.691.6 ± 7.8
350 97.7 ± 2.095.7 ± 3.294.5 ± 4.290.9 ± 5.7
375 97.1 ± 1.895.4 ± 2.492.5 ± 5.089.2 ± 6.2
400 96.6 ± 1.995.0 ± 2.491.4 ± 4.688.4 ± 5.9

Downloads