imagining syntax

← schedopt_v4

free-3c84b515

done · peak unseen_mismatch 85.9

α schedule

α 3.593 ×52 α 4.019 ×28 α 0.9766 ×11 α 0.2553 ×13 α 3.218 ×19 α 1.084 ×30 α 4.947 ×46 α 3.688 ×11 α 1.443 ×17 α 3.728 ×12 α 2.472 ×15 α 0.7549 ×20 α 3.462 ×15 α 4.598 ×11 α 4.598 ×100

direction
mixed
α range
0.2553–4.947
stages
15

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.598

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 54.3 ± 5.151.1 ± 2.352.3 ± 4.449.8 ± 2.2
110 56.7 ± 8.651.3 ± 3.054.5 ± 7.950.0 ± 2.5
120 61.8 ± 13.354.6 ± 7.458.8 ± 13.151.8 ± 5.9
130 65.9 ± 15.457.0 ± 9.662.8 ± 15.454.4 ± 8.7
140 71.1 ± 18.360.1 ± 11.968.5 ± 19.057.5 ± 11.2
150 75.2 ± 19.258.9 ± 13.273.6 ± 19.956.5 ± 12.8
160 81.5 ± 18.664.7 ± 15.180.0 ± 19.461.7 ± 14.8
170 86.1 ± 16.872.6 ± 16.784.1 ± 17.869.7 ± 16.0
180 88.8 ± 15.478.3 ± 15.386.4 ± 16.474.8 ± 14.7
190 90.0 ± 14.081.1 ± 14.687.2 ± 15.177.1 ± 14.0
200 90.2 ± 12.284.0 ± 11.986.2 ± 14.578.5 ± 12.7
210 90.5 ± 11.485.5 ± 11.485.7 ± 13.979.5 ± 12.6
220 91.9 ± 11.788.2 ± 11.888.5 ± 13.782.9 ± 13.4
230 92.9 ± 10.687.0 ± 13.089.7 ± 13.681.9 ± 14.8
240 91.3 ± 9.587.8 ± 9.085.9 ± 12.580.4 ± 11.1
250 91.7 ± 8.687.7 ± 7.685.0 ± 12.079.9 ± 9.4
260 94.0 ± 8.891.3 ± 8.290.0 ± 11.985.6 ± 10.5
270 95.0 ± 11.290.4 ± 10.592.6 ± 14.085.9 ± 12.5
280 94.0 ± 12.583.8 ± 15.491.4 ± 17.779.8 ± 18.3
290 90.7 ± 13.282.3 ± 10.586.3 ± 19.376.5 ± 13.8
300 85.5 ± 13.982.8 ± 11.080.5 ± 19.173.8 ± 12.2
310 87.5 ± 11.175.8 ± 1.180.0 ± 16.967.0 ± 1.9
320 89.5 ± 9.886.5 ± 6.881.8 ± 16.174.3 ± 6.3
330 90.2 ± 8.184.6 ± 5.081.7 ± 13.473.4 ± 4.6
340 90.0 ± 7.086.9 ± 4.179.7 ± 13.874.3 ± 4.7
350 90.4 ± 6.889.3 ± 5.681.5 ± 13.276.2 ± 6.1
360 90.3 ± 6.089.5 ± 5.281.8 ± 11.977.8 ± 6.8
370 90.4 ± 5.489.3 ± 5.082.0 ± 8.778.5 ± 4.0
380 89.3 ± 5.388.5 ± 4.580.0 ± 8.376.2 ± 3.9
390 88.7 ± 4.087.5 ± 4.378.9 ± 7.274.7 ± 2.5
400 88.9 ± 3.687.5 ± 3.577.2 ± 5.575.0 ± 2.3

Downloads