imagining syntax

← schedopt_confirm_v2

fixed_16

done · peak unseen_mismatch 81.9

Referenced by

α schedule

α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25

direction
constant
α range
1.6–1.6
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.549.9 ± 1.650.2 ± 1.849.9 ± 1.6
50 50.8 ± 1.749.7 ± 1.750.2 ± 1.549.9 ± 1.5
75 50.7 ± 1.750.0 ± 1.750.2 ± 1.849.9 ± 1.5
100 51.6 ± 2.749.6 ± 1.650.6 ± 2.449.6 ± 1.8
125 54.3 ± 7.549.5 ± 3.453.3 ± 7.649.4 ± 3.1
150 61.6 ± 15.448.7 ± 7.360.3 ± 15.648.4 ± 7.0
175 71.4 ± 20.150.2 ± 10.870.2 ± 20.849.3 ± 10.5
200 81.8 ± 19.852.1 ± 16.980.9 ± 20.651.1 ± 16.3
225 91.3 ± 15.258.3 ± 22.290.6 ± 16.157.5 ± 21.4
250 97.1 ± 9.660.7 ± 24.896.7 ± 10.560.2 ± 24.3
275 98.4 ± 8.069.3 ± 26.498.3 ± 8.468.4 ± 25.9
300 99.0 ± 5.873.8 ± 25.298.9 ± 6.272.7 ± 25.0
325 99.4 ± 4.478.2 ± 25.099.3 ± 4.477.3 ± 24.6
350 99.6 ± 2.782.9 ± 23.299.5 ± 3.281.9 ± 22.9

Downloads