imagining syntax

← schedopt_bo_r9

r9_c0

done · peak unseen_mismatch 84.7

α schedule

α 5.0 ×25 α 4.6117 ×25 α 4.0038 ×25 α 0.0593 ×25 α 0.0532 ×25 α 2.8857 ×25 α 2.6168 ×25 α 2.3768 ×25 α 0.036 ×25 α 0.0327 ×25 α 0.0296 ×25 α 1.6023 ×25 α 1.4405 ×25 α 0.0215 ×25

direction
mixed
α range
0.0215–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0215

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 1.950.6 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.1 ± 2.550.5 ± 1.750.5 ± 1.549.5 ± 1.5
100 54.3 ± 7.251.1 ± 1.952.7 ± 6.250.1 ± 1.6
125 60.3 ± 15.148.4 ± 9.358.4 ± 15.747.2 ± 9.3
150 73.4 ± 19.251.4 ± 16.172.0 ± 19.149.8 ± 14.9
175 86.4 ± 16.470.2 ± 16.685.0 ± 17.467.8 ± 16.3
200 95.4 ± 8.685.7 ± 12.794.1 ± 9.983.5 ± 13.1
225 99.8 ± 1.078.7 ± 23.199.8 ± 0.978.6 ± 22.7
250 100.0 ± 0.066.8 ± 25.5100.0 ± 0.166.4 ± 25.5
275 100.0 ± 0.058.6 ± 27.0100.0 ± 0.059.2 ± 26.5
300 100.0 ± 0.070.6 ± 25.4100.0 ± 0.070.8 ± 25.1
325 100.0 ± 0.085.4 ± 19.4100.0 ± 0.184.7 ± 19.5
350 100.0 ± 0.074.4 ± 23.1100.0 ± 0.074.5 ± 22.6

Downloads