imagining syntax

← schedopt_bo_r2

r2_c7

done · peak unseen_mismatch 93.4

α schedule

α 1.5059 ×25 α 1.5148 ×25 α 1.5321 ×25 α 1.5575 ×25 α 1.5911 ×25 α 1.6327 ×25 α 1.6822 ×25 α 1.7396 ×25 α 1.8048 ×25 α 1.8779 ×25 α 1.9587 ×25 α 2.0472 ×25 α 2.1435 ×25 α 2.2474 ×25 α 2.359 ×25 α 2.4782 ×25

direction
ascending
α range
1.5059–2.4782
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.4782

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.6 ± 1.450.2 ± 1.749.8 ± 1.249.4 ± 1.8
50 50.5 ± 1.950.1 ± 1.650.0 ± 1.649.7 ± 1.7
75 50.7 ± 1.349.5 ± 1.650.3 ± 1.349.5 ± 1.7
100 50.4 ± 2.050.1 ± 1.650.1 ± 1.350.3 ± 1.4
125 51.7 ± 2.149.4 ± 1.550.8 ± 2.549.2 ± 1.9
150 56.4 ± 12.048.2 ± 6.355.5 ± 11.847.3 ± 6.9
175 63.6 ± 18.847.6 ± 8.563.0 ± 18.547.4 ± 8.4
200 72.9 ± 21.852.2 ± 12.472.5 ± 21.851.2 ± 11.9
225 78.5 ± 23.758.3 ± 14.778.2 ± 23.858.1 ± 14.3
250 82.3 ± 23.060.2 ± 19.982.3 ± 22.859.5 ± 20.4
275 87.5 ± 19.472.5 ± 21.186.7 ± 20.071.5 ± 20.8
300 91.3 ± 16.079.6 ± 18.990.8 ± 16.278.5 ± 18.3
325 96.1 ± 10.288.6 ± 13.795.4 ± 10.987.3 ± 13.9
350 97.9 ± 7.491.1 ± 13.096.9 ± 8.389.1 ± 13.3
375 98.8 ± 1.895.1 ± 8.397.7 ± 2.993.0 ± 8.3
400 98.7 ± 1.396.3 ± 4.597.2 ± 2.893.4 ± 5.2

Downloads