imagining syntax

← schedopt_design

p06

done · peak unseen_mismatch 84.3

α schedule

α 1.0163 ×25 α 1.0253 ×25 α 1.0467 ×25 α 1.0825 ×25 α 1.1341 ×25 α 1.2026 ×25 α 1.289 ×25 α 1.394 ×25 α 1.5186 ×25 α 1.6632 ×25 α 1.8286 ×25 α 2.0154 ×25 α 2.224 ×25 α 2.4549 ×25 α 2.7087 ×25 α 2.9858 ×25

direction
ascending
α range
1.0163–2.9858
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.9858

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.549.8 ± 1.849.9 ± 1.849.7 ± 1.5
50 50.5 ± 1.750.4 ± 1.650.1 ± 1.350.1 ± 1.6
75 50.4 ± 1.649.4 ± 1.550.2 ± 1.449.6 ± 1.7
100 50.3 ± 1.750.0 ± 1.349.8 ± 1.350.0 ± 1.6
125 51.1 ± 1.849.4 ± 1.650.8 ± 2.049.3 ± 1.8
150 52.9 ± 5.748.8 ± 3.152.2 ± 5.648.4 ± 3.2
175 58.7 ± 15.745.5 ± 9.458.8 ± 15.745.6 ± 9.0
200 67.4 ± 22.144.0 ± 14.267.5 ± 22.044.7 ± 14.6
225 69.6 ± 22.944.1 ± 15.969.7 ± 22.844.2 ± 16.3
250 76.5 ± 23.042.8 ± 20.176.5 ± 22.842.5 ± 19.8
275 84.3 ± 20.650.5 ± 23.183.5 ± 21.450.1 ± 22.9
300 89.9 ± 18.450.1 ± 28.589.6 ± 18.850.2 ± 28.3
325 92.3 ± 16.162.1 ± 26.391.8 ± 16.961.5 ± 25.9
350 94.5 ± 14.069.6 ± 23.394.3 ± 14.269.3 ± 23.1
375 96.6 ± 9.978.5 ± 24.895.9 ± 11.677.9 ± 24.2
400 98.5 ± 5.485.9 ± 25.197.1 ± 8.784.3 ± 25.0

Downloads