imagining syntax

← schedopt_bo_r2

r2_c0

done · peak unseen_mismatch 97.3

α schedule

α 3.3144 ×25 α 3.3084 ×25 α 3.2908 ×25 α 3.2577 ×25 α 3.2058 ×25 α 3.1322 ×25 α 3.0342 ×25 α 2.9092 ×25 α 2.7552 ×25 α 2.5698 ×25 α 2.351 ×25 α 2.0969 ×25 α 1.8056 ×25 α 1.4751 ×25 α 1.1039 ×25 α 0.69 ×25

direction
descending
α range
0.69–3.3144
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.69

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.450.2 ± 1.750.0 ± 1.649.5 ± 1.7
50 51.6 ± 1.450.4 ± 1.550.2 ± 1.149.9 ± 1.7
75 52.3 ± 1.750.1 ± 1.650.5 ± 1.549.4 ± 1.5
100 56.2 ± 6.654.0 ± 3.952.4 ± 4.150.2 ± 2.2
125 66.8 ± 12.463.5 ± 10.558.2 ± 11.155.6 ± 8.8
150 77.1 ± 10.574.3 ± 10.365.5 ± 11.863.1 ± 11.0
175 84.6 ± 5.581.9 ± 5.471.5 ± 10.068.4 ± 8.9
200 88.0 ± 3.785.6 ± 3.574.2 ± 8.571.6 ± 7.7
225 89.7 ± 3.387.4 ± 3.275.4 ± 8.072.8 ± 7.9
250 91.0 ± 2.188.8 ± 1.976.3 ± 5.973.6 ± 5.5
275 93.2 ± 1.991.3 ± 1.879.5 ± 5.177.1 ± 4.7
300 94.7 ± 1.592.9 ± 1.682.4 ± 4.478.7 ± 4.5
325 96.5 ± 1.195.1 ± 1.486.2 ± 4.282.5 ± 5.1
350 98.7 ± 0.897.6 ± 1.392.8 ± 3.789.4 ± 4.3
375 99.7 ± 0.399.2 ± 0.698.3 ± 1.195.1 ± 3.7
400 100.0 ± 0.099.4 ± 1.199.8 ± 0.397.3 ± 4.1

Downloads