imagining syntax

← schedopt_v4

free-95c14102

done · peak unseen_mismatch 97.2

α schedule

α 4.164 ×170 α 0.0 ×32 α 4.458 ×80 α 0.7149 ×18 α 0.7149 ×100

direction
mixed
α range
0.0–4.458
stages
5

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.7149

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 61.2 ± 8.457.0 ± 6.554.4 ± 6.451.8 ± 3.6
110 65.8 ± 9.961.9 ± 8.556.5 ± 8.453.7 ± 6.0
120 70.6 ± 10.767.0 ± 9.359.7 ± 9.356.6 ± 7.3
130 74.7 ± 9.771.1 ± 9.362.1 ± 9.358.7 ± 8.1
140 78.2 ± 7.974.3 ± 7.764.3 ± 8.860.6 ± 7.3
150 79.9 ± 6.576.6 ± 5.964.7 ± 8.561.5 ± 7.1
160 81.1 ± 5.378.0 ± 4.965.2 ± 8.762.4 ± 6.9
170 81.6 ± 5.278.8 ± 4.865.8 ± 8.163.0 ± 6.6
180 84.6 ± 7.281.8 ± 7.172.6 ± 10.369.3 ± 9.2
190 91.2 ± 8.787.9 ± 9.085.5 ± 11.281.0 ± 10.7
200 96.7 ± 7.794.2 ± 8.195.3 ± 8.891.6 ± 9.1
210 96.8 ± 9.493.5 ± 10.195.7 ± 9.891.1 ± 10.6
220 91.9 ± 10.487.5 ± 12.386.8 ± 12.281.1 ± 13.4
230 86.4 ± 3.580.3 ± 4.171.9 ± 6.766.8 ± 2.2
240 84.6 ± 2.578.7 ± 3.469.2 ± 6.365.7 ± 2.1
250 87.8 ± 4.083.1 ± 1.873.0 ± 8.971.0 ± 4.8
260 86.9 ± 2.283.4 ± 0.873.2 ± 7.271.2 ± 4.5
270 87.5 ± 2.283.9 ± 2.073.0 ± 7.170.6 ± 5.8
280 88.2 ± 3.386.3 ± 3.973.8 ± 8.772.3 ± 8.1
290 91.9 ± 3.089.3 ± 3.180.9 ± 8.378.7 ± 7.7
300 97.3 ± 1.995.4 ± 1.893.4 ± 5.190.5 ± 4.1
310 99.8 ± 0.199.3 ± 0.198.3 ± 1.297.2 ± 0.7

Downloads