imagining syntax

← schedopt_bo_r4

r4_c5

done · peak unseen_mismatch 91.8

α schedule

α 1.4165 ×25 α 1.4214 ×25 α 1.4346 ×25 α 1.4585 ×25 α 1.4948 ×25 α 1.545 ×25 α 1.6106 ×25 α 1.6927 ×25 α 1.7926 ×25 α 1.9112 ×25 α 2.0496 ×25 α 2.2087 ×25 α 2.3894 ×25 α 2.5925 ×25 α 2.8189 ×25 α 3.0694 ×25

direction
ascending
α range
1.4165–3.0694
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.0694

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.449.8 ± 1.649.7 ± 1.549.6 ± 1.6
50 50.8 ± 1.949.9 ± 1.549.7 ± 1.449.9 ± 1.5
75 50.5 ± 1.449.7 ± 1.650.2 ± 1.549.4 ± 1.8
100 50.7 ± 2.550.1 ± 1.350.3 ± 1.550.0 ± 1.7
125 52.1 ± 2.449.3 ± 1.951.1 ± 3.049.2 ± 2.3
150 57.2 ± 13.449.6 ± 5.856.1 ± 13.148.8 ± 6.1
175 62.3 ± 17.646.7 ± 8.662.1 ± 17.646.7 ± 8.2
200 73.1 ± 22.347.7 ± 14.272.7 ± 22.647.1 ± 14.2
225 80.2 ± 21.551.8 ± 19.879.9 ± 21.751.8 ± 19.0
250 88.2 ± 19.158.8 ± 21.887.4 ± 19.657.8 ± 21.4
275 93.4 ± 14.474.1 ± 20.692.8 ± 15.473.3 ± 20.5
300 95.9 ± 12.982.9 ± 19.495.6 ± 13.482.5 ± 19.0
325 96.9 ± 10.288.7 ± 15.196.1 ± 11.887.6 ± 15.3
350 97.6 ± 8.187.2 ± 18.096.7 ± 8.685.6 ± 17.2
375 98.3 ± 3.992.4 ± 13.696.7 ± 5.190.0 ± 12.8
400 98.2 ± 2.195.0 ± 7.996.1 ± 3.891.8 ± 7.5

Downloads