imagining syntax

← schedopt_calib

fixed_16

done · peak unseen_mismatch 86.6

α schedule

α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25 α 1.6 ×25

direction
constant
α range
1.6–1.6
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.749.6 ± 1.650.0 ± 2.050.2 ± 1.8
50 50.9 ± 1.950.3 ± 1.450.4 ± 1.649.9 ± 1.7
75 51.1 ± 2.149.9 ± 1.850.2 ± 1.749.1 ± 1.5
100 51.6 ± 2.650.0 ± 1.550.8 ± 2.350.0 ± 1.3
125 55.4 ± 8.348.5 ± 3.654.5 ± 8.348.6 ± 3.6
150 63.3 ± 17.948.3 ± 10.963.0 ± 18.048.1 ± 10.0
175 70.3 ± 19.946.2 ± 12.269.5 ± 19.945.8 ± 11.7
200 79.6 ± 20.149.5 ± 16.479.1 ± 20.449.3 ± 16.1
225 93.8 ± 12.058.4 ± 22.593.1 ± 12.757.5 ± 21.3
250 97.7 ± 8.560.1 ± 27.297.5 ± 8.759.7 ± 26.5
275 98.8 ± 6.256.2 ± 28.898.4 ± 7.756.3 ± 28.4
300 99.9 ± 0.467.8 ± 26.199.9 ± 0.467.7 ± 25.9
325 100.0 ± 0.077.0 ± 24.099.9 ± 0.376.5 ± 23.6
350 100.0 ± 0.184.1 ± 19.199.8 ± 0.783.1 ± 18.9
375 99.9 ± 0.287.5 ± 17.299.7 ± 0.786.6 ± 17.2
400 99.9 ± 0.384.5 ± 20.099.6 ± 0.984.2 ± 19.2

Downloads