imagining syntax

← schedopt_bo_r3

r3_c1

done · peak unseen_mismatch 96.9

α schedule

α 3.7417 ×25 α 3.7395 ×25 α 3.7306 ×25 α 3.7098 ×25 α 3.6717 ×25 α 3.6105 ×25 α 3.5205 ×25 α 3.3957 ×25 α 3.2299 ×25 α 3.0171 ×25 α 2.7509 ×25 α 2.425 ×25 α 2.0329 ×25 α 1.5681 ×25 α 1.024 ×25 α 0.3941 ×25

direction
descending
α range
0.3941–3.7417
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.3941

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.350.3 ± 1.749.9 ± 1.649.5 ± 1.9
50 51.4 ± 1.650.3 ± 1.550.0 ± 1.249.8 ± 1.8
75 52.1 ± 2.050.0 ± 1.650.6 ± 1.349.4 ± 1.6
100 58.0 ± 7.555.4 ± 5.052.6 ± 4.050.5 ± 2.0
125 69.2 ± 10.566.2 ± 9.459.4 ± 9.356.6 ± 7.8
150 78.3 ± 8.076.0 ± 7.966.0 ± 8.262.9 ± 7.3
175 83.7 ± 5.081.8 ± 4.368.5 ± 8.765.7 ± 8.1
200 84.6 ± 3.282.7 ± 3.268.0 ± 6.065.6 ± 6.3
225 86.2 ± 2.984.0 ± 2.569.4 ± 5.666.9 ± 5.7
250 88.0 ± 2.386.0 ± 2.371.2 ± 4.668.6 ± 4.9
275 89.9 ± 2.488.0 ± 2.073.4 ± 5.071.1 ± 4.9
300 92.1 ± 1.890.6 ± 2.077.5 ± 5.174.7 ± 4.7
325 95.2 ± 1.393.5 ± 1.382.7 ± 3.979.3 ± 4.0
350 98.2 ± 0.797.2 ± 0.891.4 ± 2.988.0 ± 3.8
375 99.8 ± 0.299.5 ± 0.498.6 ± 0.996.9 ± 1.5
400 100.0 ± 0.097.9 ± 6.4100.0 ± 0.196.5 ± 9.2

Downloads