imagining syntax

← schedopt_bo_r7

r7_c2

done · peak unseen_mismatch 89.7

α schedule

α 2.9291 ×25 α 2.9411 ×25 α 2.9512 ×25 α 0.7194 ×25 α 0.7215 ×25 α 2.9772 ×25 α 2.985 ×25 α 2.9926 ×25 α 0.729 ×25 α 0.7307 ×25 α 0.7324 ×25 α 3.0209 ×25 α 3.0276 ×25 α 0.7373 ×25

direction
mixed
α range
0.7194–3.0276
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7373

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.250.5 ± 1.650.1 ± 1.549.4 ± 1.8
50 51.4 ± 1.550.3 ± 1.549.7 ± 1.150.1 ± 1.6
75 52.0 ± 1.849.8 ± 1.650.5 ± 1.549.6 ± 1.7
100 52.4 ± 4.150.3 ± 1.951.2 ± 3.149.8 ± 1.5
125 57.3 ± 10.948.9 ± 2.855.2 ± 11.348.2 ± 2.5
150 66.6 ± 18.552.3 ± 9.264.7 ± 18.850.7 ± 8.4
175 78.7 ± 20.065.7 ± 16.776.9 ± 20.363.1 ± 15.7
200 87.8 ± 15.881.0 ± 16.385.4 ± 16.978.2 ± 16.7
225 95.0 ± 11.482.5 ± 18.694.4 ± 12.381.4 ± 18.1
250 99.6 ± 1.679.4 ± 24.699.3 ± 2.578.6 ± 24.5
275 100.0 ± 0.078.2 ± 25.0100.0 ± 0.178.0 ± 24.8
300 99.7 ± 0.982.7 ± 25.099.2 ± 3.282.0 ± 24.2
325 99.1 ± 1.490.0 ± 17.797.9 ± 3.087.7 ± 16.8
350 100.0 ± 0.090.0 ± 19.5100.0 ± 0.089.7 ± 19.2

Downloads