imagining syntax

← schedopt_bo_r1

r1_c1

done · peak unseen_mismatch 90.5

α schedule

α 1.5563 ×25 α 1.5564 ×25 α 1.5573 ×25 α 1.5601 ×25 α 1.5664 ×25 α 1.578 ×25 α 1.5975 ×25 α 1.6275 ×25 α 1.6712 ×25 α 1.7321 ×25 α 1.8141 ×25 α 1.9214 ×25 α 2.0584 ×25 α 2.2302 ×25 α 2.442 ×25 α 2.6992 ×25

direction
ascending
α range
1.5563–2.6992
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.6992

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.5 ± 1.650.1 ± 1.549.8 ± 1.749.5 ± 2.1
50 50.6 ± 1.750.2 ± 1.650.2 ± 1.549.5 ± 1.5
75 50.4 ± 1.549.6 ± 1.750.3 ± 1.349.5 ± 1.6
100 50.6 ± 2.550.1 ± 1.550.5 ± 1.749.8 ± 1.2
125 52.0 ± 3.149.2 ± 2.051.0 ± 3.348.8 ± 2.4
150 56.9 ± 14.649.0 ± 9.256.0 ± 14.548.2 ± 9.2
175 63.3 ± 17.847.7 ± 8.962.9 ± 17.847.4 ± 8.9
200 74.5 ± 22.151.9 ± 13.674.3 ± 22.351.8 ± 13.4
225 79.7 ± 22.855.7 ± 21.279.3 ± 23.155.5 ± 20.7
250 85.1 ± 20.659.7 ± 25.584.5 ± 21.058.9 ± 25.4
275 90.9 ± 16.772.1 ± 22.090.3 ± 17.171.4 ± 21.7
300 95.1 ± 13.277.9 ± 24.694.8 ± 13.277.7 ± 23.9
325 98.1 ± 5.381.8 ± 22.897.2 ± 6.380.4 ± 22.8
350 99.5 ± 0.887.2 ± 19.098.9 ± 1.785.9 ± 19.1
375 99.1 ± 1.290.3 ± 16.697.9 ± 2.588.6 ± 15.4
400 98.8 ± 1.592.6 ± 13.997.4 ± 2.890.5 ± 13.2

Downloads