imagining syntax

← schedopt_bo_r7

r7_c3

done · peak unseen_mismatch 96.8

α schedule

α 2.8591 ×25 α 2.8586 ×25 α 2.8558 ×25 α 1.2615 ×25 α 1.2544 ×25 α 2.8038 ×25 α 2.7585 ×25 α 2.6912 ×25 α 1.1499 ×25 α 1.093 ×25 α 1.0184 ×25 α 2.0839 ×25 α 1.8145 ×25 α 0.657 ×25

direction
mixed
α range
0.657–2.8591
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.657

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.250.4 ± 1.650.0 ± 1.549.4 ± 1.7
50 51.3 ± 1.650.3 ± 1.649.9 ± 1.149.7 ± 1.7
75 51.8 ± 1.549.8 ± 1.750.4 ± 1.349.6 ± 1.5
100 52.5 ± 4.550.8 ± 1.651.2 ± 2.849.8 ± 1.5
125 59.1 ± 13.050.4 ± 2.957.2 ± 13.249.1 ± 2.9
150 68.9 ± 18.459.7 ± 10.866.7 ± 18.956.5 ± 9.3
175 79.3 ± 18.771.6 ± 16.976.6 ± 19.068.7 ± 16.0
200 88.6 ± 13.883.0 ± 13.684.8 ± 15.078.8 ± 14.3
225 96.5 ± 9.889.9 ± 13.595.6 ± 10.487.8 ± 14.5
250 98.2 ± 7.789.0 ± 14.797.8 ± 8.887.3 ± 15.5
275 99.7 ± 1.390.2 ± 14.199.7 ± 1.288.9 ± 14.3
300 99.4 ± 0.893.4 ± 10.697.9 ± 2.790.0 ± 10.7
325 99.4 ± 0.697.9 ± 2.897.8 ± 2.694.9 ± 5.2
350 100.0 ± 0.096.8 ± 9.7100.0 ± 0.096.8 ± 9.4

Downloads