imagining syntax

← schedopt_v4

free-b261320b

done · peak unseen_mismatch 79.8

α schedule

α 4.245 ×61 α 1.613 ×94 α 4.384 ×25 α 1.112 ×53 α 4.671 ×67 α 4.671 ×100

direction
mixed
α range
1.112–4.671
stages
6

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 4.671

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 55.7 ± 7.552.1 ± 4.652.9 ± 7.050.7 ± 3.5
110 58.4 ± 10.253.7 ± 7.254.9 ± 9.451.4 ± 5.5
120 62.3 ± 13.656.4 ± 10.158.9 ± 13.253.7 ± 8.8
130 67.8 ± 16.960.1 ± 13.064.7 ± 16.356.8 ± 11.8
140 72.2 ± 18.463.2 ± 15.169.6 ± 18.559.9 ± 13.8
150 78.1 ± 18.466.9 ± 16.375.7 ± 19.263.6 ± 15.6
160 82.2 ± 17.769.8 ± 16.479.9 ± 18.666.7 ± 15.9
170 86.3 ± 16.476.6 ± 16.483.5 ± 17.072.7 ± 15.8
180 87.6 ± 14.980.0 ± 14.684.2 ± 15.775.9 ± 14.7
190 88.9 ± 14.978.9 ± 15.086.3 ± 15.275.2 ± 14.0
200 91.8 ± 13.981.2 ± 14.690.5 ± 14.778.8 ± 14.2
210 93.5 ± 13.580.1 ± 16.892.4 ± 14.077.5 ± 16.6
220 93.9 ± 15.275.1 ± 18.093.4 ± 15.773.3 ± 16.7
230 94.2 ± 15.471.3 ± 22.094.0 ± 15.969.6 ± 21.1
240 93.4 ± 15.067.6 ± 21.493.0 ± 15.367.0 ± 20.5
250 93.6 ± 14.373.2 ± 19.792.5 ± 16.171.7 ± 19.1
260 90.8 ± 17.266.7 ± 15.890.0 ± 17.465.2 ± 14.9
270 91.3 ± 17.774.3 ± 15.691.0 ± 17.273.1 ± 15.1
280 91.0 ± 16.777.9 ± 18.290.0 ± 17.675.9 ± 17.2
290 90.5 ± 16.379.0 ± 19.087.5 ± 19.676.6 ± 20.1
300 85.6 ± 16.869.7 ± 15.779.4 ± 22.064.9 ± 16.0
310 86.6 ± 15.379.4 ± 11.979.0 ± 21.672.7 ± 14.4
320 85.7 ± 14.684.0 ± 14.479.8 ± 20.179.8 ± 19.3
330 79.9 ± 13.178.5 ± 11.771.5 ± 18.170.8 ± 17.2
340 81.2 ± 13.279.8 ± 10.972.8 ± 18.270.5 ± 17.4
350 82.9 ± 9.880.0 ± 7.772.1 ± 17.469.0 ± 15.7
360 83.0 ± 9.881.7 ± 7.673.0 ± 15.370.8 ± 13.3
370 83.8 ± 9.382.5 ± 7.271.5 ± 16.771.0 ± 14.4
380 82.8 ± 8.581.6 ± 6.471.0 ± 13.871.2 ± 12.3
390 83.5 ± 8.182.4 ± 6.271.8 ± 12.471.5 ± 11.6
400 84.5 ± 7.183.0 ± 5.373.0 ± 12.872.8 ± 10.2

Downloads