imagining syntax

← schedopt_bo_r2

r2_c6

done · peak unseen_mismatch 89.8

α schedule

α 1.6149 ×25 α 1.6357 ×25 α 1.6729 ×25 α 1.7249 ×25 α 1.7909 ×25 α 1.8703 ×25 α 1.9626 ×25 α 2.0676 ×25 α 2.1848 ×25 α 2.314 ×25 α 2.455 ×25 α 2.6076 ×25 α 2.7716 ×25 α 2.9468 ×25 α 3.1332 ×25 α 3.3304 ×25

direction
ascending
α range
1.6149–3.3304
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.3304

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.450.3 ± 1.649.8 ± 1.649.5 ± 2.0
50 50.8 ± 1.450.0 ± 1.650.1 ± 1.449.8 ± 1.3
75 50.6 ± 1.549.7 ± 1.750.2 ± 1.349.8 ± 1.7
100 50.5 ± 2.150.1 ± 1.550.0 ± 1.349.8 ± 1.5
125 52.2 ± 2.849.4 ± 1.851.3 ± 3.049.2 ± 2.1
150 55.3 ± 9.550.4 ± 2.453.8 ± 9.349.3 ± 1.7
175 63.5 ± 16.051.9 ± 6.162.3 ± 15.950.9 ± 4.8
200 77.3 ± 20.060.5 ± 17.876.0 ± 20.259.1 ± 17.3
225 84.0 ± 21.069.1 ± 19.483.4 ± 21.267.8 ± 18.2
250 88.2 ± 18.476.7 ± 18.586.8 ± 19.873.7 ± 19.1
275 92.9 ± 13.987.2 ± 14.690.8 ± 14.283.8 ± 14.6
300 94.2 ± 12.590.3 ± 13.992.1 ± 12.787.4 ± 14.0
325 95.7 ± 8.893.5 ± 9.492.9 ± 9.489.8 ± 10.0
350 96.0 ± 5.994.2 ± 6.691.9 ± 7.589.0 ± 7.9
375 95.7 ± 2.393.9 ± 2.590.8 ± 5.087.0 ± 5.5
400 95.3 ± 2.393.4 ± 2.888.6 ± 5.685.5 ± 5.6

Downloads