imagining syntax

← schedopt_v4

burst16_ext

done · peak unseen_mismatch 88.3

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.7 ×25 α 0.7 ×25 α 3.143 ×25 α 3.143 ×25 α 3.143 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25 α 1.286 ×25 α 1.286 ×25 α 0.7 ×25 α 0.7 ×25 α 0.7 ×25

direction
mixed
α range
0.7–5.0
stages
16

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 55.5 ± 6.650.8 ± 3.653.1 ± 6.148.7 ± 2.2
110 57.3 ± 8.750.1 ± 4.354.9 ± 8.448.8 ± 3.1
120 60.1 ± 13.749.9 ± 5.458.4 ± 13.948.8 ± 5.4
130 64.2 ± 15.851.4 ± 7.462.1 ± 15.950.6 ± 7.0
140 69.5 ± 18.056.4 ± 14.467.9 ± 18.255.6 ± 13.6
150 76.3 ± 18.262.0 ± 15.974.1 ± 19.060.8 ± 14.4
160 82.9 ± 15.170.3 ± 16.179.9 ± 16.966.9 ± 15.4
170 88.2 ± 11.776.6 ± 12.885.5 ± 13.173.7 ± 12.4
180 92.7 ± 6.681.7 ± 9.389.3 ± 8.977.6 ± 9.3
190 93.7 ± 4.986.8 ± 6.090.5 ± 6.681.3 ± 6.4
200 94.5 ± 4.288.7 ± 4.891.3 ± 6.283.2 ± 6.3
210 96.9 ± 2.889.7 ± 6.494.7 ± 3.185.5 ± 6.9
220 99.3 ± 1.089.4 ± 12.899.1 ± 1.188.3 ± 13.4
230 100.0 ± 0.076.7 ± 17.699.9 ± 0.175.3 ± 16.7
240 99.9 ± 0.172.0 ± 18.5100.0 ± 0.170.4 ± 16.9
250 100.0 ± 0.076.9 ± 21.2100.0 ± 0.076.2 ± 19.7
260 100.0 ± 0.078.2 ± 19.1100.0 ± 0.076.9 ± 17.4
270 100.0 ± 0.068.9 ± 14.2100.0 ± 0.067.8 ± 12.4
280 100.0 ± 0.061.7 ± 14.1100.0 ± 0.061.9 ± 14.7
290 100.0 ± 0.073.8 ± 19.3100.0 ± 0.074.4 ± 17.3
300 100.0 ± 0.072.0 ± 22.8100.0 ± 0.073.8 ± 20.7
310 100.0 ± 0.049.1 ± 0.0100.0 ± 0.053.4 ± 0.0
320 100.0 ± 0.068.1 ± 0.0100.0 ± 0.072.1 ± 0.0
330 100.0 ± 0.049.6 ± 0.0100.0 ± 0.053.3 ± 0.0
340 100.0 ± 0.048.9 ± 0.0100.0 ± 0.052.9 ± 0.0
350 100.0 ± 0.030.7 ± 0.0100.0 ± 0.036.2 ± 0.0
360 100.0 ± 0.044.9 ± 0.0100.0 ± 0.048.8 ± 0.0
370 100.0 ± 0.048.9 ± 0.0100.0 ± 0.053.0 ± 0.0
380 100.0 ± 0.036.3 ± 0.0100.0 ± 0.038.3 ± 0.0
390 100.0 ± 0.047.2 ± 0.0100.0 ± 0.049.5 ± 0.0
400 100.0 ± 0.019.9 ± 0.0100.0 ± 0.022.2 ± 0.0

Downloads