imagining syntax

← schedopt_bo_r5

r5_c2

done · peak unseen_mismatch 89.8

α schedule

α 2.1319 ×25 α 2.1328 ×25 α 2.1351 ×25 α 2.139 ×25 α 2.1446 ×25 α 2.1522 ×25 α 2.1618 ×25 α 2.1736 ×25 α 2.1877 ×25 α 2.2041 ×25 α 2.223 ×25 α 2.2445 ×25 α 2.2685 ×25 α 2.2952 ×25

direction
ascending
α range
2.1319–2.2952
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.2952

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.550.1 ± 1.849.9 ± 1.549.5 ± 1.9
50 51.0 ± 1.450.3 ± 1.649.9 ± 1.149.8 ± 1.4
75 51.1 ± 1.749.7 ± 1.850.2 ± 1.449.6 ± 1.4
100 51.7 ± 3.350.5 ± 1.650.6 ± 2.049.9 ± 1.7
125 56.4 ± 7.351.0 ± 2.953.8 ± 7.049.5 ± 2.2
150 65.6 ± 17.656.5 ± 9.162.8 ± 17.753.7 ± 8.1
175 74.8 ± 19.766.6 ± 15.372.5 ± 20.163.8 ± 14.2
200 82.3 ± 18.276.2 ± 17.279.2 ± 19.672.5 ± 17.7
225 89.0 ± 13.584.1 ± 13.485.3 ± 15.479.4 ± 14.4
250 95.3 ± 4.892.1 ± 6.391.2 ± 7.986.4 ± 8.7
275 97.2 ± 2.194.4 ± 4.693.7 ± 4.289.2 ± 5.9
300 97.6 ± 1.795.9 ± 2.193.6 ± 4.889.8 ± 6.1
325 97.1 ± 1.795.4 ± 2.591.4 ± 5.087.4 ± 6.8
350 97.1 ± 1.395.1 ± 1.890.4 ± 4.686.6 ± 5.9

Downloads