imagining syntax

← schedopt_bo_r9

r9_c1

done · peak unseen_mismatch 99.2

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.0264 ×25 α 0.0265 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.027 ×25 α 0.0272 ×25 α 0.0275 ×25 α 5.0 ×25 α 5.0 ×25 α 0.0288 ×25

direction
mixed
α range
0.0264–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0288

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 54.1 ± 7.250.9 ± 1.952.8 ± 6.450.0 ± 2.3
125 60.6 ± 15.148.3 ± 5.958.6 ± 15.647.3 ± 7.0
150 74.3 ± 20.258.3 ± 13.772.9 ± 20.356.1 ± 12.0
175 85.7 ± 14.376.9 ± 15.583.0 ± 15.373.4 ± 15.1
200 91.3 ± 7.487.6 ± 8.486.7 ± 10.582.3 ± 10.9
225 99.2 ± 1.788.6 ± 16.999.1 ± 1.887.9 ± 17.1
250 100.0 ± 0.083.4 ± 22.5100.0 ± 0.082.5 ± 22.9
275 100.0 ± 0.072.2 ± 28.1100.0 ± 0.072.1 ± 28.5
300 100.0 ± 0.194.7 ± 11.899.9 ± 0.493.8 ± 12.6
325 98.6 ± 2.295.9 ± 7.397.2 ± 4.193.2 ± 8.9
350 100.0 ± 0.099.3 ± 1.9100.0 ± 0.099.2 ± 1.8

Downloads