imagining syntax

← schedopt_bo_r2

r2_c4

done · peak unseen_mismatch 50.6

α schedule

α 1.5241 ×25 α 1.5177 ×25 α 1.5048 ×25 α 1.4854 ×25 α 1.4594 ×25 α 1.4269 ×25 α 1.3878 ×25 α 1.3421 ×25 α 1.2898 ×25 α 1.231 ×25 α 1.1655 ×25 α 1.0935 ×25 α 1.0148 ×25 α 0.9295 ×25 α 0.8376 ×25 α 0.739 ×25

direction
descending
α range
0.739–1.5241
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.739

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.5 ± 1.450.0 ± 1.549.9 ± 1.449.4 ± 1.9
50 50.6 ± 2.050.1 ± 1.750.0 ± 1.649.8 ± 1.6
75 50.7 ± 1.549.5 ± 1.750.3 ± 1.349.5 ± 1.9
100 50.3 ± 2.150.4 ± 1.450.1 ± 1.550.0 ± 1.2
125 51.8 ± 2.749.1 ± 2.050.9 ± 3.249.0 ± 2.7
150 55.7 ± 11.549.4 ± 4.854.7 ± 11.548.8 ± 5.5
175 61.9 ± 16.744.7 ± 10.861.7 ± 16.744.9 ± 11.0
200 71.7 ± 21.945.8 ± 12.571.3 ± 22.046.2 ± 12.5
225 77.3 ± 23.649.2 ± 15.577.4 ± 23.649.7 ± 15.9
250 82.5 ± 21.946.4 ± 21.882.2 ± 22.146.2 ± 21.5
275 86.8 ± 21.143.3 ± 22.286.7 ± 21.242.9 ± 21.8
300 91.3 ± 17.242.9 ± 24.391.2 ± 17.343.7 ± 24.2
325 96.5 ± 10.345.2 ± 22.996.3 ± 10.845.6 ± 22.3
350 98.0 ± 9.746.7 ± 21.297.9 ± 9.946.8 ± 21.6
375 98.1 ± 9.549.8 ± 21.198.1 ± 9.450.6 ± 21.4
400 99.9 ± 0.645.2 ± 19.799.9 ± 0.445.0 ± 19.7

Downloads