imagining syntax

← schedopt_bo_r1

r1_c4

done · peak unseen_mismatch 91.3

α schedule

α 1.5633 ×25 α 1.5646 ×25 α 1.5699 ×25 α 1.5821 ×25 α 1.6046 ×25 α 1.6405 ×25 α 1.6932 ×25 α 1.7662 ×25 α 1.8631 ×25 α 1.9873 ×25 α 2.1426 ×25 α 2.3326 ×25 α 2.5609 ×25 α 2.8314 ×25 α 3.1478 ×25 α 3.5139 ×25

direction
ascending
α range
1.5633–3.5139
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.5139

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.650.1 ± 1.549.9 ± 1.649.5 ± 2.1
50 50.7 ± 1.850.1 ± 1.650.1 ± 1.549.7 ± 1.4
75 50.5 ± 1.649.6 ± 1.650.3 ± 1.349.5 ± 1.5
100 50.5 ± 2.150.2 ± 1.650.2 ± 1.449.9 ± 1.4
125 52.1 ± 2.849.0 ± 2.151.2 ± 3.249.1 ± 2.3
150 56.4 ± 12.449.4 ± 6.755.3 ± 12.348.6 ± 6.7
175 64.0 ± 18.350.5 ± 10.063.6 ± 18.149.6 ± 9.8
200 72.4 ± 21.452.2 ± 14.671.7 ± 21.651.6 ± 14.6
225 80.2 ± 22.458.7 ± 20.979.4 ± 22.758.2 ± 20.2
250 86.2 ± 20.368.4 ± 24.285.5 ± 20.767.3 ± 23.2
275 90.5 ± 16.875.7 ± 23.089.4 ± 17.574.2 ± 22.7
300 94.9 ± 11.078.1 ± 24.393.8 ± 11.676.2 ± 23.8
325 97.9 ± 5.689.6 ± 15.096.6 ± 6.687.7 ± 14.5
350 97.8 ± 4.690.4 ± 17.196.0 ± 5.988.0 ± 16.7
375 97.2 ± 3.195.1 ± 3.994.2 ± 5.691.3 ± 6.2
400 96.6 ± 2.795.1 ± 3.192.5 ± 5.889.9 ± 6.7

Downloads