imagining syntax

← schedopt_bo_r4

r4_c1

done · peak unseen_mismatch 93.9

α schedule

α 1.7748 ×25 α 1.7851 ×25 α 1.8009 ×25 α 1.821 ×25 α 1.845 ×25 α 1.8725 ×25 α 1.9031 ×25 α 1.9368 ×25 α 1.9733 ×25 α 2.0125 ×25 α 2.0543 ×25 α 2.0985 ×25 α 2.1451 ×25 α 2.1941 ×25 α 2.2453 ×25 α 2.2986 ×25

direction
ascending
α range
1.7748–2.2986
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.2986

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.550.0 ± 1.550.2 ± 1.549.4 ± 1.8
50 50.8 ± 1.950.3 ± 1.550.0 ± 1.450.0 ± 1.4
75 50.6 ± 1.549.7 ± 1.850.3 ± 1.449.3 ± 1.7
100 50.8 ± 2.450.4 ± 1.450.3 ± 1.649.8 ± 1.6
125 53.1 ± 3.349.5 ± 1.751.5 ± 3.049.0 ± 2.0
150 58.7 ± 13.151.3 ± 5.556.9 ± 12.450.2 ± 5.5
175 68.5 ± 18.455.4 ± 11.567.2 ± 18.354.8 ± 10.5
200 79.5 ± 21.962.4 ± 12.478.4 ± 22.161.7 ± 12.5
225 83.8 ± 20.569.9 ± 18.782.5 ± 21.468.5 ± 18.7
250 91.0 ± 13.481.0 ± 16.188.6 ± 15.278.6 ± 16.2
275 97.6 ± 5.190.4 ± 9.896.6 ± 5.488.2 ± 11.1
300 99.0 ± 1.694.6 ± 6.197.7 ± 3.091.8 ± 6.9
325 99.1 ± 1.096.5 ± 4.097.5 ± 3.193.9 ± 5.4
350 98.7 ± 1.296.1 ± 5.095.9 ± 4.392.3 ± 6.8
375 98.3 ± 1.497.0 ± 2.495.0 ± 4.192.1 ± 6.1
400 98.0 ± 1.597.0 ± 1.994.6 ± 4.092.2 ± 5.0

Downloads