imagining syntax

← schedopt_bo_r2

r2_c2

done · peak unseen_mismatch 50.1

α schedule

α 1.2808 ×25 α 1.2648 ×25 α 1.2502 ×25 α 1.2363 ×25 α 1.223 ×25 α 1.2101 ×25 α 1.1974 ×25 α 1.185 ×25 α 1.1728 ×25 α 1.1608 ×25 α 1.149 ×25 α 1.1373 ×25 α 1.1257 ×25 α 1.1143 ×25 α 1.103 ×25 α 1.0917 ×25

direction
descending
α range
1.0917–1.2808
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0917

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.449.9 ± 1.549.9 ± 1.349.5 ± 2.0
50 50.7 ± 1.549.8 ± 1.650.2 ± 1.549.7 ± 1.9
75 50.9 ± 1.349.5 ± 1.650.3 ± 1.649.6 ± 1.8
100 50.5 ± 2.349.9 ± 1.750.1 ± 1.950.1 ± 1.5
125 51.3 ± 2.249.3 ± 2.050.5 ± 2.249.3 ± 2.1
150 54.6 ± 11.147.9 ± 7.253.5 ± 10.847.8 ± 6.5
175 59.3 ± 15.845.3 ± 9.458.9 ± 15.445.5 ± 9.7
200 69.4 ± 21.445.8 ± 15.769.0 ± 21.746.0 ± 16.4
225 73.6 ± 23.844.3 ± 13.173.8 ± 23.544.7 ± 14.0
250 76.7 ± 23.038.5 ± 16.576.6 ± 22.938.5 ± 16.6
275 82.3 ± 21.840.1 ± 15.981.7 ± 22.639.8 ± 15.7
300 87.9 ± 17.433.4 ± 16.987.7 ± 17.632.8 ± 16.9
325 97.6 ± 8.832.0 ± 19.997.5 ± 8.831.6 ± 20.6
350 98.9 ± 5.230.8 ± 16.398.8 ± 5.931.0 ± 16.5
375 100.0 ± 0.039.4 ± 23.4100.0 ± 0.039.9 ± 23.3
400 100.0 ± 0.040.4 ± 25.4100.0 ± 0.040.4 ± 25.5

Downloads