imagining syntax

← schedopt_bo_r1

r1_c6

done · peak unseen_mismatch 49.9

α schedule

α 2.463 ×25 α 2.0338 ×25 α 1.7693 ×25 α 1.5668 ×25 α 1.3989 ×25 α 1.2536 ×25 α 1.1245 ×25 α 1.0077 ×25 α 0.9004 ×25 α 0.8011 ×25 α 0.7082 ×25 α 0.6209 ×25 α 0.5383 ×25 α 0.4599 ×25 α 0.3851 ×25 α 0.3136 ×25

direction
descending
α range
0.3136–2.463
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.3136

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.6 ± 1.450.3 ± 1.650.0 ± 1.549.3 ± 1.8
50 51.0 ± 1.350.3 ± 1.549.8 ± 1.349.9 ± 1.7
75 51.2 ± 1.749.7 ± 1.750.5 ± 1.549.4 ± 1.3
100 51.1 ± 2.750.2 ± 1.750.6 ± 1.749.7 ± 1.5
125 55.3 ± 8.248.7 ± 2.853.6 ± 8.748.7 ± 2.7
150 62.0 ± 16.249.4 ± 5.260.4 ± 16.148.2 ± 4.4
175 73.9 ± 21.447.3 ± 13.773.2 ± 21.846.9 ± 13.5
200 80.1 ± 22.347.7 ± 20.780.0 ± 22.347.5 ± 20.2
225 83.7 ± 22.144.1 ± 25.483.8 ± 22.045.0 ± 25.2
250 87.6 ± 18.940.6 ± 25.687.0 ± 19.740.8 ± 25.4
275 94.7 ± 12.442.5 ± 32.794.5 ± 12.642.7 ± 32.9
300 99.6 ± 1.640.6 ± 29.699.6 ± 1.740.3 ± 29.4
325 100.0 ± 0.033.0 ± 27.2100.0 ± 0.033.1 ± 27.0
350 100.0 ± 0.029.9 ± 27.4100.0 ± 0.030.0 ± 27.3
375 100.0 ± 0.027.7 ± 26.4100.0 ± 0.028.2 ± 26.6
400 100.0 ± 0.027.9 ± 25.9100.0 ± 0.028.2 ± 25.8

Downloads