imagining syntax

← schedopt_v4

fixed_1.9

done · peak unseen_mismatch 97.1

α schedule

α 1.9 ×400

direction
constant
α range
1.9–1.9
stages
1

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.9

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 51.7 ± 2.250.0 ± 1.050.0 ± 1.850.1 ± 1.9
110 52.5 ± 2.449.7 ± 1.451.1 ± 2.049.7 ± 2.0
120 52.3 ± 3.049.8 ± 1.751.4 ± 3.149.7 ± 1.5
130 52.8 ± 3.449.8 ± 1.551.8 ± 3.449.3 ± 1.8
140 55.2 ± 8.949.8 ± 3.554.6 ± 8.449.3 ± 2.3
150 59.0 ± 13.049.7 ± 6.857.6 ± 13.148.2 ± 5.2
160 62.3 ± 14.050.6 ± 8.160.9 ± 14.049.5 ± 6.7
170 65.9 ± 16.951.9 ± 9.363.7 ± 17.150.6 ± 8.0
180 69.2 ± 19.153.9 ± 13.167.8 ± 19.252.4 ± 12.2
190 76.5 ± 19.859.9 ± 15.575.0 ± 20.058.1 ± 15.7
200 81.5 ± 18.458.9 ± 13.780.5 ± 19.257.5 ± 13.8
210 86.4 ± 17.663.1 ± 11.985.0 ± 18.560.7 ± 10.7
220 89.5 ± 16.969.2 ± 12.788.1 ± 17.667.1 ± 11.8
230 91.5 ± 16.271.4 ± 18.490.3 ± 16.969.8 ± 17.2
240 91.6 ± 15.371.7 ± 16.090.8 ± 15.970.5 ± 15.4
250 92.1 ± 14.975.3 ± 14.991.4 ± 15.373.5 ± 14.7
260 94.7 ± 12.279.0 ± 13.594.5 ± 12.276.9 ± 13.4
270 95.2 ± 11.483.5 ± 12.694.5 ± 12.181.4 ± 12.6
280 95.8 ± 8.985.1 ± 11.195.2 ± 9.883.6 ± 11.1
290 97.9 ± 3.388.3 ± 4.597.5 ± 3.888.0 ± 3.1
300 98.7 ± 1.891.6 ± 8.198.1 ± 2.989.7 ± 6.8
310 98.8 ± 1.187.7 ± 8.096.8 ± 2.983.7 ± 6.8
320 99.0 ± 0.976.6 ± 16.697.2 ± 2.578.7 ± 13.1
330 100.0 ± 0.069.6 ± 0.0100.0 ± 0.071.8 ± 0.0
340 100.0 ± 0.068.0 ± 0.0100.0 ± 0.069.8 ± 0.0
350 100.0 ± 0.087.6 ± 0.0100.0 ± 0.085.2 ± 0.0
360 100.0 ± 0.089.0 ± 0.0100.0 ± 0.088.2 ± 0.0
370 100.0 ± 0.099.6 ± 0.099.6 ± 0.097.1 ± 0.0

Downloads