imagining syntax

← schedopt_bo_r4

r4_c0

done · peak unseen_mismatch 96.2

α schedule

α 4.9959 ×25 α 4.9951 ×25 α 4.9909 ×25 α 4.9787 ×25 α 4.9525 ×25 α 4.905 ×25 α 4.8277 ×25 α 4.7111 ×25 α 4.5444 ×25 α 4.316 ×25 α 4.0132 ×25 α 3.6223 ×25 α 3.1289 ×25 α 2.5175 ×25 α 1.7718 ×25 α 0.8747 ×25

direction
descending
α range
0.8747–4.9959
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.8747

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.350.5 ± 1.649.8 ± 1.449.7 ± 2.0
50 51.6 ± 2.050.5 ± 1.550.0 ± 1.450.0 ± 1.5
75 53.4 ± 2.650.7 ± 1.750.4 ± 1.449.6 ± 1.5
100 60.8 ± 8.958.5 ± 7.053.8 ± 6.051.7 ± 4.2
125 72.9 ± 8.669.6 ± 8.159.2 ± 8.156.8 ± 6.9
150 78.3 ± 3.876.2 ± 3.762.8 ± 7.060.6 ± 6.3
175 79.8 ± 3.677.7 ± 3.462.7 ± 6.160.5 ± 5.6
200 80.0 ± 2.878.2 ± 2.362.0 ± 4.460.5 ± 4.6
225 80.6 ± 3.278.9 ± 2.862.5 ± 4.761.1 ± 4.7
250 81.3 ± 2.279.8 ± 2.062.5 ± 4.261.5 ± 4.3
275 82.9 ± 2.681.8 ± 2.464.8 ± 4.463.0 ± 4.4
300 85.0 ± 2.583.7 ± 2.367.1 ± 4.965.5 ± 4.9
325 87.9 ± 2.086.2 ± 1.669.7 ± 4.868.0 ± 4.7
350 91.3 ± 1.289.7 ± 1.574.1 ± 4.572.5 ± 4.3
375 96.5 ± 1.195.3 ± 1.685.7 ± 4.682.6 ± 4.1
400 99.9 ± 0.199.0 ± 3.499.2 ± 0.796.2 ± 8.0

Downloads