imagining syntax

← schedopt_bo_r8

r8_c0

done · peak unseen_mismatch 96.8

α schedule

α 3.7185 ×25 α 3.7149 ×25 α 3.7007 ×25 α 1.4718 ×25 α 1.4482 ×25 α 3.5157 ×25 α 3.3796 ×25 α 3.1924 ×25 α 1.182 ×25 α 1.0556 ×25 α 0.8985 ×25 α 1.7624 ×25 α 1.1913 ×25 α 0.2076 ×25

direction
mixed
α range
0.2076–3.7185
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2076

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.350.3 ± 1.749.9 ± 1.749.5 ± 1.9
50 51.4 ± 1.650.3 ± 1.650.0 ± 1.249.8 ± 1.8
75 52.2 ± 2.250.0 ± 1.750.5 ± 1.349.4 ± 1.5
100 54.6 ± 5.551.9 ± 2.351.8 ± 3.149.8 ± 1.5
125 64.6 ± 14.755.4 ± 6.760.5 ± 14.552.3 ± 6.1
150 77.6 ± 16.571.0 ± 13.673.6 ± 17.765.9 ± 13.5
175 87.3 ± 10.882.5 ± 10.780.5 ± 13.775.2 ± 12.2
200 90.7 ± 6.388.0 ± 6.382.0 ± 10.178.7 ± 9.9
225 98.7 ± 2.496.6 ± 3.597.3 ± 3.293.8 ± 5.6
250 99.8 ± 0.597.1 ± 5.999.0 ± 1.194.8 ± 6.4
275 100.0 ± 0.198.1 ± 3.399.9 ± 0.396.6 ± 4.7
300 99.0 ± 0.997.5 ± 1.495.8 ± 4.091.9 ± 5.6
325 99.8 ± 0.299.1 ± 0.999.2 ± 1.196.8 ± 3.3
350 100.0 ± 0.097.3 ± 7.9100.0 ± 0.096.7 ± 9.0

Downloads