imagining syntax

← schedopt_bo_r4

r4_c3

done · peak unseen_mismatch 87.8

α schedule

α 0.7126 ×25 α 0.8033 ×25 α 0.9098 ×25 α 1.0265 ×25 α 1.1509 ×25 α 1.2818 ×25 α 1.418 ×25 α 1.559 ×25 α 1.7043 ×25 α 1.8535 ×25 α 2.0062 ×25 α 2.1622 ×25 α 2.3212 ×25 α 2.4831 ×25 α 2.6477 ×25 α 2.8148 ×25

direction
ascending
α range
0.7126–2.8148
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.8148

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.350.1 ± 1.449.8 ± 1.549.3 ± 1.7
50 50.4 ± 1.750.0 ± 1.650.2 ± 1.449.7 ± 1.7
75 50.5 ± 1.449.4 ± 1.950.2 ± 1.449.4 ± 1.8
100 50.2 ± 1.850.0 ± 1.650.1 ± 1.349.8 ± 1.5
125 51.2 ± 1.549.5 ± 1.550.3 ± 2.049.0 ± 1.9
150 52.6 ± 7.649.5 ± 1.451.5 ± 7.149.3 ± 1.4
175 57.6 ± 13.046.0 ± 6.057.7 ± 12.746.9 ± 6.2
200 65.2 ± 20.243.4 ± 12.365.2 ± 20.144.2 ± 12.7
225 71.1 ± 22.842.8 ± 14.871.4 ± 22.543.9 ± 15.3
250 76.0 ± 21.943.3 ± 14.175.1 ± 22.543.5 ± 14.0
275 83.9 ± 20.051.7 ± 19.983.2 ± 20.551.4 ± 19.4
300 91.0 ± 17.850.9 ± 26.890.8 ± 17.851.0 ± 26.4
325 93.2 ± 15.562.2 ± 26.092.8 ± 16.062.3 ± 25.3
350 95.7 ± 13.171.6 ± 24.895.5 ± 13.371.0 ± 24.1
375 96.4 ± 12.081.9 ± 23.296.1 ± 11.981.3 ± 22.6
400 97.3 ± 8.988.5 ± 16.096.9 ± 9.487.8 ± 15.9

Downloads