imagining syntax

← schedopt_bo_r3

r3_c2

done · peak unseen_mismatch 97.8

α schedule

α 3.2723 ×25 α 3.272 ×25 α 3.2701 ×25 α 3.2643 ×25 α 3.251 ×25 α 3.2257 ×25 α 3.1831 ×25 α 3.1166 ×25 α 3.0189 ×25 α 2.8816 ×25 α 2.6956 ×25 α 2.4507 ×25 α 2.1358 ×25 α 1.739 ×25 α 1.2475 ×25 α 0.6476 ×25

direction
descending
α range
0.6476–3.2723
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.6476

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.450.4 ± 1.849.8 ± 1.749.5 ± 1.8
50 51.6 ± 1.650.4 ± 1.650.1 ± 1.249.8 ± 1.8
75 52.2 ± 1.750.2 ± 1.550.5 ± 1.549.4 ± 1.7
100 55.8 ± 6.753.5 ± 3.652.2 ± 4.450.3 ± 2.1
125 66.6 ± 12.862.8 ± 10.958.3 ± 11.255.7 ± 9.0
150 76.3 ± 11.273.2 ± 11.065.5 ± 11.262.5 ± 10.3
175 84.1 ± 7.181.4 ± 6.971.2 ± 10.467.8 ± 9.8
200 87.1 ± 4.384.6 ± 4.672.8 ± 9.170.2 ± 8.8
225 88.5 ± 3.586.2 ± 3.473.6 ± 7.270.9 ± 7.1
250 89.2 ± 2.187.1 ± 2.073.6 ± 5.071.3 ± 5.4
275 90.8 ± 2.488.9 ± 2.276.3 ± 4.973.7 ± 5.1
300 92.6 ± 2.390.8 ± 2.179.0 ± 5.175.7 ± 4.9
325 94.8 ± 1.492.8 ± 1.682.1 ± 4.778.9 ± 5.1
350 97.2 ± 1.196.0 ± 1.489.0 ± 3.485.2 ± 3.8
375 99.3 ± 0.598.7 ± 0.696.0 ± 2.093.5 ± 2.7
400 100.0 ± 0.099.3 ± 2.4100.0 ± 0.197.8 ± 4.7

Downloads