imagining syntax

← schedopt_design

p05

done · peak unseen_mismatch 50.1

α schedule

α 1.1174 ×25 α 0.9279 ×25 α 0.8151 ×25 α 0.7304 ×25 α 0.661 ×25 α 0.6016 ×25 α 0.5493 ×25 α 0.5022 ×25 α 0.4592 ×25 α 0.4196 ×25 α 0.3828 ×25 α 0.3483 ×25 α 0.3158 ×25 α 0.2851 ×25 α 0.2559 ×25 α 0.2281 ×25

direction
descending
α range
0.2281–1.1174
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2281

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.5 ± 1.550.0 ± 1.649.7 ± 1.749.6 ± 1.5
50 50.7 ± 1.649.9 ± 1.750.0 ± 1.549.9 ± 1.5
75 50.6 ± 1.449.5 ± 1.850.2 ± 1.349.6 ± 1.5
100 50.1 ± 2.149.7 ± 1.350.0 ± 1.350.1 ± 1.2
125 51.2 ± 1.849.4 ± 1.850.2 ± 2.449.1 ± 2.2
150 53.0 ± 8.848.4 ± 8.052.3 ± 9.047.6 ± 7.9
175 56.3 ± 12.845.3 ± 9.856.4 ± 12.846.1 ± 10.0
200 62.6 ± 18.941.4 ± 14.262.6 ± 18.842.0 ± 14.4
225 68.4 ± 20.938.6 ± 15.968.8 ± 20.839.5 ± 16.3
250 78.8 ± 23.532.8 ± 22.178.8 ± 23.433.0 ± 21.6
275 82.1 ± 22.330.9 ± 19.181.6 ± 22.830.8 ± 19.3
300 86.9 ± 20.325.9 ± 18.486.9 ± 20.326.2 ± 18.8
325 90.7 ± 18.323.4 ± 21.190.6 ± 18.723.6 ± 21.2
350 93.6 ± 14.625.6 ± 24.993.9 ± 14.226.0 ± 25.0
375 96.0 ± 13.722.9 ± 21.596.0 ± 13.423.3 ± 21.9
400 96.3 ± 12.629.1 ± 24.296.5 ± 12.029.2 ± 24.4

Downloads