imagining syntax

← schedopt_bo_r7

r7_c5

done · peak unseen_mismatch 98.3

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.0695 ×25 α 0.0701 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.0741 ×25 α 0.0755 ×25 α 0.077 ×25 α 5.0 ×25 α 5.0 ×25 α 0.0823 ×25

direction
mixed
α range
0.0695–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0823

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 54.5 ± 7.951.1 ± 2.053.0 ± 7.050.1 ± 2.4
125 61.2 ± 14.947.9 ± 7.859.0 ± 15.646.9 ± 8.2
150 75.2 ± 19.355.9 ± 14.073.6 ± 19.953.4 ± 13.3
175 86.5 ± 13.577.3 ± 13.184.1 ± 14.474.1 ± 13.1
200 91.8 ± 8.188.1 ± 8.787.7 ± 9.983.5 ± 10.5
225 99.4 ± 1.189.9 ± 15.099.3 ± 1.389.2 ± 14.9
250 100.0 ± 0.186.7 ± 18.1100.0 ± 0.186.3 ± 18.2
275 100.0 ± 0.079.4 ± 23.1100.0 ± 0.079.3 ± 23.2
300 99.8 ± 0.894.4 ± 13.799.6 ± 2.093.7 ± 14.2
325 98.6 ± 2.195.0 ± 8.797.1 ± 4.292.2 ± 10.1
350 100.0 ± 0.098.5 ± 4.9100.0 ± 0.098.3 ± 5.5

Downloads