imagining syntax

← schedopt_design

p09

done · peak unseen_mismatch 50.0

α schedule

α 0.7152 ×25 α 0.7249 ×25 α 0.7324 ×25 α 0.739 ×25 α 0.745 ×25 α 0.7506 ×25 α 0.7559 ×25 α 0.7609 ×25 α 0.7656 ×25 α 0.7702 ×25 α 0.7746 ×25 α 0.7789 ×25 α 0.7831 ×25 α 0.7872 ×25 α 0.7911 ×25 α 0.795 ×25

direction
ascending
α range
0.7152–0.795
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.795

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.350.1 ± 1.550.0 ± 1.449.2 ± 1.7
50 50.5 ± 1.450.1 ± 1.750.1 ± 1.449.9 ± 1.8
75 50.4 ± 1.649.3 ± 1.850.0 ± 1.449.5 ± 1.9
100 50.2 ± 1.750.1 ± 1.549.8 ± 1.150.0 ± 1.5
125 51.5 ± 1.649.2 ± 1.550.5 ± 2.149.0 ± 2.2
150 52.4 ± 5.049.1 ± 2.451.5 ± 4.649.1 ± 1.9
175 57.3 ± 13.845.3 ± 7.857.6 ± 13.646.0 ± 8.0
200 65.3 ± 21.339.8 ± 16.065.1 ± 21.240.7 ± 15.9
225 70.0 ± 22.136.8 ± 17.670.3 ± 21.938.1 ± 18.2
250 76.2 ± 24.334.1 ± 18.676.1 ± 24.134.7 ± 19.1
275 78.0 ± 23.532.7 ± 22.177.5 ± 24.032.0 ± 21.9
300 82.5 ± 22.729.0 ± 17.982.8 ± 22.529.8 ± 18.2
325 87.6 ± 20.129.2 ± 19.787.3 ± 20.629.5 ± 19.4
350 90.7 ± 17.726.0 ± 20.590.7 ± 17.626.2 ± 20.4
375 93.9 ± 15.525.4 ± 20.993.8 ± 15.625.7 ± 20.6
400 96.9 ± 9.624.0 ± 20.397.1 ± 9.024.6 ± 20.6

Downloads