imagining syntax

← schedopt_bo_r7

r7_c0

done · peak unseen_mismatch 99.2

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.3692 ×25 α 0.3718 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.3808 ×25 α 0.3829 ×25 α 0.3849 ×25 α 5.0 ×25 α 5.0 ×25 α 0.3907 ×25

direction
mixed
α range
0.3692–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.3907

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 54.3 ± 7.851.3 ± 2.552.7 ± 6.949.9 ± 1.8
125 61.2 ± 15.149.0 ± 4.158.9 ± 15.848.2 ± 4.4
150 75.8 ± 18.661.9 ± 12.673.8 ± 19.059.2 ± 11.7
175 87.1 ± 12.179.3 ± 12.283.6 ± 14.175.2 ± 13.1
200 91.8 ± 6.288.3 ± 6.787.1 ± 9.182.6 ± 9.3
225 99.5 ± 1.093.0 ± 6.699.4 ± 1.192.0 ± 6.9
250 99.9 ± 0.390.1 ± 13.499.9 ± 0.489.2 ± 14.2
275 100.0 ± 0.084.8 ± 20.5100.0 ± 0.085.0 ± 19.8
300 99.5 ± 2.095.2 ± 9.299.1 ± 3.394.1 ± 10.1
325 97.9 ± 2.594.1 ± 9.195.4 ± 4.590.3 ± 10.3
350 100.0 ± 0.099.3 ± 2.4100.0 ± 0.099.2 ± 2.5

Downloads