imagining syntax

← schedopt_bo_r1

r1_c3

done · peak unseen_mismatch 90.4

α schedule

α 1.4079 ×25 α 1.417 ×25 α 1.4407 ×25 α 1.4825 ×25 α 1.5453 ×25 α 1.6312 ×25 α 1.7424 ×25 α 1.8806 ×25 α 2.0475 ×25 α 2.2445 ×25 α 2.4732 ×25 α 2.7348 ×25 α 3.0305 ×25 α 3.3617 ×25 α 3.7295 ×25 α 4.1348 ×25

direction
ascending
α range
1.4079–4.1348
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.1348

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.6 ± 1.349.8 ± 1.549.6 ± 1.449.6 ± 1.8
50 50.6 ± 1.750.1 ± 1.749.6 ± 1.349.8 ± 1.6
75 50.7 ± 1.749.5 ± 1.750.3 ± 1.549.5 ± 1.8
100 50.7 ± 2.649.9 ± 1.750.5 ± 1.749.7 ± 1.7
125 53.4 ± 5.748.8 ± 3.052.2 ± 5.548.6 ± 2.6
150 56.8 ± 12.548.5 ± 4.555.8 ± 12.748.2 ± 4.7
175 62.9 ± 17.347.2 ± 9.862.8 ± 17.347.5 ± 9.3
200 73.6 ± 22.050.2 ± 11.773.1 ± 22.150.0 ± 12.1
225 80.2 ± 21.959.7 ± 17.079.3 ± 22.158.9 ± 16.8
250 87.4 ± 18.669.0 ± 20.886.6 ± 19.368.2 ± 20.7
275 92.3 ± 14.184.0 ± 16.590.9 ± 15.882.1 ± 16.9
300 95.6 ± 8.789.2 ± 13.394.0 ± 11.186.7 ± 14.6
325 98.0 ± 3.593.4 ± 10.096.1 ± 6.590.4 ± 11.1
350 97.8 ± 2.793.8 ± 9.095.4 ± 5.489.9 ± 9.9
375 96.6 ± 2.594.5 ± 3.192.8 ± 5.389.7 ± 5.5
400 95.6 ± 2.694.1 ± 2.990.4 ± 5.787.5 ± 6.4

Downloads