imagining syntax

← schedopt_design

p00

done · peak unseen_mismatch 75.1

α schedule

α 3.2472 ×25 α 3.1691 ×25 α 3.1198 ×25 α 3.0817 ×25 α 3.0498 ×25 α 3.0221 ×25 α 2.9973 ×25 α 2.9748 ×25 α 2.954 ×25 α 2.9347 ×25 α 2.9166 ×25 α 2.8996 ×25 α 2.8834 ×25 α 2.868 ×25 α 2.8533 ×25 α 2.8393 ×25

direction
descending
α range
2.8393–3.2472
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.8393

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.450.2 ± 1.749.9 ± 1.649.6 ± 1.6
50 51.7 ± 1.650.4 ± 1.750.1 ± 1.349.8 ± 1.9
75 52.3 ± 1.750.1 ± 1.650.6 ± 1.649.5 ± 1.7
100 55.8 ± 7.153.3 ± 3.452.4 ± 4.650.0 ± 2.2
125 66.6 ± 12.862.0 ± 10.858.4 ± 11.155.7 ± 8.7
150 76.6 ± 12.073.7 ± 11.566.7 ± 12.463.4 ± 11.4
175 84.8 ± 7.082.2 ± 6.972.6 ± 11.269.1 ± 10.1
200 88.3 ± 4.285.6 ± 4.474.6 ± 9.272.1 ± 9.1
225 89.8 ± 3.587.4 ± 3.375.4 ± 7.272.6 ± 7.6
250 90.3 ± 2.187.7 ± 1.974.7 ± 5.572.0 ± 5.2
275 90.9 ± 2.488.6 ± 2.076.2 ± 5.073.2 ± 4.8
300 91.5 ± 1.889.8 ± 2.177.1 ± 4.474.1 ± 4.2
325 91.8 ± 1.789.8 ± 1.777.0 ± 4.673.7 ± 4.8
350 92.7 ± 1.490.9 ± 1.878.0 ± 4.275.1 ± 4.7
375 92.4 ± 2.090.6 ± 2.077.1 ± 4.973.7 ± 4.9
400 92.8 ± 1.590.9 ± 1.878.6 ± 3.974.4 ± 4.3

Downloads