imagining syntax

← schedopt_bo_r6

r6_c7

done · peak unseen_mismatch 96.5

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.2387 ×25 α 0.2334 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.2168 ×25 α 0.2134 ×25 α 0.2102 ×25 α 5.0 ×25 α 5.0 ×25 α 0.2015 ×25

direction
mixed
α range
0.2015–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2015

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 54.6 ± 7.351.1 ± 2.152.7 ± 6.349.8 ± 1.9
125 61.1 ± 15.249.1 ± 7.659.1 ± 15.748.0 ± 7.9
150 75.2 ± 18.960.6 ± 13.573.1 ± 19.358.4 ± 12.4
175 86.3 ± 13.577.1 ± 12.983.0 ± 14.673.3 ± 13.1
200 90.8 ± 9.587.2 ± 10.086.4 ± 10.881.9 ± 11.0
225 98.3 ± 6.789.8 ± 13.798.2 ± 7.189.7 ± 13.0
250 100.0 ± 0.180.4 ± 24.3100.0 ± 0.180.0 ± 24.6
275 100.0 ± 0.072.2 ± 32.2100.0 ± 0.072.0 ± 32.2
300 99.6 ± 1.793.3 ± 11.299.4 ± 2.992.5 ± 11.5
325 98.1 ± 2.794.1 ± 6.296.0 ± 4.590.3 ± 8.3
350 100.0 ± 0.096.7 ± 8.6100.0 ± 0.096.5 ± 8.7

Downloads