imagining syntax

← schedopt_bo_r8

r8_c7

done · peak unseen_mismatch 91.6

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.6099 ×25 α 1.6266 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.6742 ×25 α 1.6835 ×25 α 1.692 ×25 α 5.0 ×25 α 5.0 ×25 α 1.7145 ×25

direction
mixed
α range
1.6099–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.7145

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.9 ± 1.449.7 ± 2.0
50 51.5 ± 2.050.5 ± 1.550.0 ± 1.350.0 ± 1.6
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.349.6 ± 1.5
100 57.3 ± 8.654.5 ± 4.653.2 ± 6.450.6 ± 2.6
125 69.4 ± 15.062.1 ± 11.963.2 ± 14.957.0 ± 10.1
150 81.6 ± 11.177.6 ± 10.874.0 ± 13.169.1 ± 12.1
175 86.9 ± 5.383.9 ± 5.577.2 ± 10.472.8 ± 10.2
200 86.6 ± 4.684.1 ± 4.774.5 ± 9.371.8 ± 8.8
225 95.3 ± 2.793.4 ± 3.188.6 ± 6.385.9 ± 7.0
250 96.5 ± 1.594.7 ± 1.889.0 ± 4.584.9 ± 5.1
275 97.6 ± 0.996.2 ± 1.491.5 ± 3.788.1 ± 3.7
300 91.4 ± 2.289.1 ± 2.179.3 ± 4.575.3 ± 4.6
325 90.6 ± 1.688.4 ± 1.678.3 ± 3.174.5 ± 3.4
350 98.5 ± 0.797.6 ± 0.994.5 ± 1.891.6 ± 2.3

Downloads