imagining syntax

← schedopt_bo_r3

r3_c3

done · peak unseen_mismatch 90.7

α schedule

α 1.2326 ×25 α 1.3231 ×25 α 1.4284 ×25 α 1.543 ×25 α 1.6647 ×25 α 1.7922 ×25 α 1.9247 ×25 α 2.0616 ×25 α 2.2023 ×25 α 2.3465 ×25 α 2.4939 ×25 α 2.6442 ×25 α 2.7974 ×25 α 2.953 ×25 α 3.1112 ×25 α 3.2716 ×25

direction
ascending
α range
1.2326–3.2716
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.2716

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.450.1 ± 1.549.8 ± 1.349.4 ± 1.9
50 50.5 ± 1.750.1 ± 1.550.1 ± 1.549.9 ± 1.7
75 50.8 ± 1.349.4 ± 1.550.2 ± 1.549.5 ± 1.7
100 50.2 ± 2.050.1 ± 1.449.9 ± 1.750.0 ± 1.3
125 51.5 ± 1.849.2 ± 1.650.7 ± 1.849.3 ± 1.9
150 53.9 ± 7.748.6 ± 4.152.7 ± 7.248.5 ± 4.1
175 60.1 ± 16.348.3 ± 5.059.7 ± 15.948.2 ± 5.1
200 69.5 ± 20.053.6 ± 11.569.0 ± 20.253.2 ± 11.1
225 78.2 ± 20.963.3 ± 17.677.8 ± 20.762.4 ± 16.7
250 85.8 ± 19.870.9 ± 18.685.0 ± 19.769.2 ± 17.7
275 91.5 ± 14.382.6 ± 17.690.7 ± 14.581.3 ± 16.9
300 96.0 ± 10.488.3 ± 14.294.9 ± 10.286.2 ± 14.8
325 96.6 ± 9.591.8 ± 10.994.8 ± 10.089.1 ± 10.0
350 96.5 ± 8.593.9 ± 8.694.5 ± 9.790.7 ± 9.8
375 96.2 ± 7.594.5 ± 6.993.1 ± 9.590.1 ± 8.9
400 96.5 ± 3.994.7 ± 4.192.4 ± 6.990.0 ± 7.0

Downloads