imagining syntax

← schedopt_v5_confirm

cand3

done · peak unseen_mismatch 91.6

Referenced by

α schedule

α 3.2007 ×25 α 3.1661 ×25 α 3.1038 ×25 α 3.016 ×25 α 2.904 ×25 α 2.7689 ×25 α 2.6113 ×25 α 2.4318 ×25 α 2.2309 ×25 α 2.009 ×25 α 1.7666 ×25 α 1.5038 ×25 α 1.221 ×25 α 0.9185 ×25 α 0.5965 ×25 α 0.2551 ×25

direction
descending
α range
0.2551–3.2007
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2551

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 56.3 ± 6.452.8 ± 4.152.7 ± 5.450.5 ± 3.0
110 59.8 ± 8.755.5 ± 6.355.0 ± 7.951.9 ± 4.5
120 64.7 ± 11.259.9 ± 8.758.4 ± 10.654.3 ± 6.8
130 70.3 ± 12.265.2 ± 10.862.7 ± 12.357.7 ± 8.9
140 75.1 ± 12.670.2 ± 11.366.4 ± 13.661.1 ± 10.6
150 79.9 ± 11.375.4 ± 10.370.4 ± 13.365.3 ± 10.8
160 83.8 ± 10.079.9 ± 9.373.5 ± 12.968.5 ± 11.1
170 86.2 ± 8.682.7 ± 8.375.8 ± 11.970.9 ± 10.8
180 88.0 ± 7.185.2 ± 7.077.3 ± 10.773.0 ± 9.7
190 89.7 ± 5.887.0 ± 5.378.6 ± 9.274.5 ± 8.6
200 90.8 ± 4.988.4 ± 4.679.7 ± 8.675.9 ± 8.1
210 91.9 ± 4.489.5 ± 4.180.7 ± 8.076.7 ± 7.3
220 92.8 ± 3.690.6 ± 3.581.5 ± 7.477.8 ± 7.0
230 93.5 ± 3.291.4 ± 3.182.9 ± 6.979.1 ± 6.5
240 94.5 ± 2.592.7 ± 2.384.4 ± 6.280.7 ± 5.8
250 94.8 ± 2.193.1 ± 2.184.7 ± 5.381.2 ± 5.0
260 95.8 ± 2.094.3 ± 2.086.9 ± 5.183.2 ± 4.9
270 96.6 ± 1.795.1 ± 1.688.1 ± 4.784.3 ± 4.5
280 97.1 ± 1.395.7 ± 1.489.2 ± 3.885.2 ± 4.1
290 98.0 ± 1.296.7 ± 1.491.8 ± 3.687.8 ± 4.2
300 98.3 ± 1.097.0 ± 1.392.0 ± 3.587.5 ± 4.0
310 99.0 ± 0.798.0 ± 1.094.6 ± 3.190.5 ± 3.8
320 99.4 ± 0.498.2 ± 0.995.7 ± 2.590.8 ± 3.9
330 99.5 ± 0.598.2 ± 0.696.5 ± 1.989.8 ± 3.2
340 99.8 ± 0.298.6 ± 1.398.1 ± 1.291.6 ± 5.5
350 99.9 ± 0.196.3 ± 5.597.1 ± 3.686.1 ± 12.9
360 100.0 ± 0.097.2 ± 3.499.0 ± 0.887.1 ± 11.8
370 100.0 ± 0.093.6 ± 0.099.9 ± 0.073.3 ± 0.0
380 100.0 ± 0.078.6 ± 0.0100.0 ± 0.058.7 ± 0.0
390 100.0 ± 0.060.0 ± 0.0100.0 ± 0.051.8 ± 0.0
400 100.0 ± 0.086.1 ± 0.0100.0 ± 0.073.1 ± 0.0

Downloads