imagining syntax

← schedopt_bo_r6

r6_c0

done · peak unseen_mismatch 72.1

α schedule

α 1.9838 ×25 α 2.7442 ×25 α 3.1925 ×25 α 2.564 ×25 α 2.7625 ×25 α 4.034 ×25 α 4.2392 ×25 α 4.4234 ×25 α 3.3371 ×25 α 3.4493 ×25 α 3.5535 ×25 α 5.0 ×25 α 5.0 ×25 α 3.8293 ×25

direction
mixed
α range
1.9838–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.8293

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.6 ± 1.350.2 ± 1.850.0 ± 1.549.5 ± 1.5
50 50.9 ± 1.550.4 ± 1.550.0 ± 1.550.0 ± 1.6
75 51.4 ± 1.749.8 ± 1.650.4 ± 1.549.4 ± 1.8
100 52.3 ± 4.250.9 ± 2.051.1 ± 2.450.2 ± 1.6
125 59.6 ± 10.354.7 ± 7.754.9 ± 8.851.1 ± 6.0
150 68.1 ± 13.664.0 ± 12.362.0 ± 11.658.2 ± 9.7
175 77.2 ± 12.674.5 ± 12.369.0 ± 13.265.6 ± 12.1
200 82.6 ± 8.580.5 ± 7.971.9 ± 11.568.0 ± 10.4
225 87.3 ± 5.685.0 ± 5.575.4 ± 10.072.1 ± 9.9
250 87.6 ± 4.585.9 ± 4.074.4 ± 8.671.8 ± 8.4
275 88.2 ± 3.986.4 ± 3.374.3 ± 7.771.2 ± 7.2
300 86.8 ± 3.485.2 ± 2.672.2 ± 6.569.2 ± 5.8
325 86.2 ± 3.184.7 ± 2.470.5 ± 5.868.0 ± 5.5
350 87.6 ± 2.985.8 ± 2.172.1 ± 5.569.5 ± 5.0

Downloads