imagining syntax

← schedopt_bo_r7

r7_c7

done · peak unseen_mismatch 99.4

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.866 ×25 α 1.8518 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.6768 ×25 α 1.5896 ×25 α 1.479 ×25 α 5.0 ×25 α 4.743 ×25 α 0.9761 ×25

direction
mixed
α range
0.9761–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.9761

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 58.5 ± 9.655.8 ± 5.653.5 ± 7.750.7 ± 3.7
125 71.5 ± 14.665.1 ± 12.763.8 ± 14.758.5 ± 11.0
150 81.9 ± 10.378.0 ± 10.172.7 ± 12.368.2 ± 11.0
175 86.4 ± 4.983.3 ± 4.974.5 ± 9.471.3 ± 8.8
200 84.8 ± 3.882.7 ± 3.871.4 ± 7.668.4 ± 6.6
225 94.5 ± 2.892.8 ± 2.886.4 ± 6.384.0 ± 6.1
250 97.1 ± 1.495.4 ± 1.690.2 ± 4.487.1 ± 4.8
275 98.4 ± 0.797.4 ± 0.993.9 ± 3.091.0 ± 3.3
300 90.7 ± 2.488.4 ± 2.278.5 ± 4.275.2 ± 4.0
325 91.0 ± 2.088.8 ± 2.179.5 ± 3.875.6 ± 4.7
350 100.0 ± 0.199.8 ± 0.399.8 ± 0.399.4 ± 0.7

Downloads