imagining syntax

← schedopt_bo_r9

r9_c7

done · peak unseen_mismatch 98.5

α schedule

α 3.9283 ×25 α 3.934 ×25 α 3.9553 ×25 α 0.4894 ×25 α 0.4998 ×25 α 4.2196 ×25 α 4.41 ×25 α 4.6692 ×25 α 0.6123 ×25 α 0.6648 ×25 α 0.7296 ×25 α 5.0 ×25 α 5.0 ×25 α 1.0113 ×25

direction
mixed
α range
0.4894–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0113

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.250.3 ± 1.749.7 ± 1.549.6 ± 1.7
50 51.4 ± 1.650.2 ± 1.750.0 ± 1.149.8 ± 1.7
75 52.4 ± 2.250.1 ± 1.650.8 ± 1.349.4 ± 1.6
100 53.3 ± 4.750.8 ± 1.951.5 ± 3.049.7 ± 1.6
125 59.9 ± 13.748.4 ± 5.258.0 ± 14.148.2 ± 5.4
150 71.4 ± 18.557.0 ± 8.969.7 ± 19.154.8 ± 7.8
175 84.7 ± 14.674.2 ± 13.481.7 ± 15.970.3 ± 13.6
200 89.8 ± 10.886.4 ± 11.186.3 ± 11.981.5 ± 11.7
225 98.1 ± 5.990.4 ± 13.897.7 ± 6.489.9 ± 13.6
250 100.0 ± 0.188.8 ± 15.399.9 ± 0.388.0 ± 15.7
275 100.0 ± 0.084.0 ± 22.7100.0 ± 0.084.0 ± 22.6
300 99.3 ± 1.796.1 ± 6.298.2 ± 4.493.6 ± 8.5
325 97.4 ± 2.694.3 ± 4.694.3 ± 5.189.1 ± 8.3
350 100.0 ± 0.099.2 ± 1.9100.0 ± 0.198.5 ± 2.8

Downloads