imagining syntax

← schedopt_bo_r7

r7_c6

done · peak unseen_mismatch 95.7

α schedule

α 3.4059 ×25 α 3.4046 ×25 α 3.3996 ×25 α 0.7756 ×25 α 0.7709 ×25 α 3.3343 ×25 α 3.2861 ×25 α 3.2196 ×25 α 0.7169 ×25 α 0.6913 ×25 α 0.6593 ×25 α 2.7095 ×25 α 2.5053 ×25 α 0.5183 ×25

direction
mixed
α range
0.5183–3.4059
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.5183

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.550.3 ± 1.650.0 ± 1.449.5 ± 1.8
50 51.5 ± 1.450.5 ± 1.550.0 ± 1.449.9 ± 1.9
75 52.3 ± 2.050.0 ± 1.750.4 ± 1.749.5 ± 1.5
100 53.0 ± 4.450.5 ± 1.851.8 ± 4.149.5 ± 1.7
125 59.5 ± 13.148.7 ± 4.656.7 ± 13.347.6 ± 5.0
150 69.9 ± 18.456.9 ± 9.967.8 ± 18.454.7 ± 8.2
175 81.3 ± 16.871.7 ± 15.478.3 ± 17.768.3 ± 14.5
200 90.7 ± 9.685.5 ± 10.586.7 ± 12.380.7 ± 12.2
225 98.8 ± 3.386.6 ± 14.398.2 ± 4.284.9 ± 14.5
250 100.0 ± 0.282.8 ± 18.499.9 ± 0.682.3 ± 18.3
275 100.0 ± 0.078.4 ± 25.9100.0 ± 0.078.2 ± 25.9
300 99.6 ± 1.386.4 ± 21.799.1 ± 2.785.4 ± 21.1
325 99.1 ± 1.393.8 ± 11.897.7 ± 3.390.8 ± 11.5
350 100.0 ± 0.096.0 ± 11.0100.0 ± 0.095.7 ± 10.7

Downloads