imagining syntax

← schedopt_design

p03

done · peak unseen_mismatch 90.4

α schedule

α 4.0412 ×25 α 4.0407 ×25 α 4.038 ×25 α 4.0303 ×25 α 4.0138 ×25 α 3.9841 ×25 α 3.9357 ×25 α 3.8628 ×25 α 3.7588 ×25 α 3.6164 ×25 α 3.4279 ×25 α 3.1848 ×25 α 2.8782 ×25 α 2.4986 ×25 α 2.0361 ×25 α 1.48 ×25

direction
descending
α range
1.48–4.0412
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.48

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.250.4 ± 1.649.9 ± 1.549.5 ± 1.8
50 51.4 ± 1.650.2 ± 1.750.0 ± 1.149.8 ± 1.6
75 52.6 ± 2.150.1 ± 1.750.9 ± 1.349.4 ± 1.6
100 58.9 ± 7.956.6 ± 4.953.4 ± 4.351.3 ± 2.9
125 70.9 ± 10.467.8 ± 9.958.8 ± 9.156.6 ± 8.1
150 78.4 ± 6.376.1 ± 6.564.4 ± 7.861.7 ± 7.6
175 81.9 ± 3.979.9 ± 3.566.1 ± 7.363.7 ± 7.1
200 83.0 ± 3.181.1 ± 2.965.2 ± 5.663.1 ± 5.7
225 84.1 ± 2.982.1 ± 2.766.4 ± 5.163.9 ± 5.3
250 84.6 ± 2.083.3 ± 2.066.2 ± 3.864.5 ± 4.1
275 86.1 ± 2.384.6 ± 2.168.1 ± 4.666.0 ± 4.4
300 88.6 ± 2.787.1 ± 2.472.3 ± 5.869.7 ± 5.6
325 90.3 ± 2.088.6 ± 1.473.4 ± 5.470.9 ± 5.2
350 92.7 ± 1.691.2 ± 1.577.3 ± 4.474.2 ± 4.6
375 95.2 ± 1.494.0 ± 1.382.1 ± 4.479.4 ± 4.1
400 98.8 ± 0.597.9 ± 0.893.6 ± 2.690.4 ± 2.9

Downloads