imagining syntax

← schedopt_bo_r4

r4_c6

done · peak unseen_mismatch 98.5

α schedule

α 2.7429 ×25 α 2.7423 ×25 α 2.7391 ×25 α 2.7306 ×25 α 2.7133 ×25 α 2.6833 ×25 α 2.6361 ×25 α 2.5669 ×25 α 2.4704 ×25 α 2.3411 ×25 α 2.1731 ×25 α 1.9602 ×25 α 1.6957 ×25 α 1.373 ×25 α 0.9849 ×25 α 0.524 ×25

direction
descending
α range
0.524–2.7429
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.524

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.0 ± 1.350.4 ± 1.850.1 ± 1.349.4 ± 1.8
50 51.4 ± 1.450.3 ± 1.749.8 ± 1.250.0 ± 1.7
75 51.7 ± 1.649.8 ± 1.750.3 ± 1.649.5 ± 1.7
100 53.5 ± 5.051.3 ± 2.251.6 ± 3.749.7 ± 1.5
125 63.5 ± 12.758.3 ± 9.357.9 ± 11.753.2 ± 7.1
150 73.0 ± 16.169.7 ± 14.267.2 ± 15.462.9 ± 13.0
175 82.5 ± 11.478.6 ± 11.973.7 ± 12.569.1 ± 11.4
200 89.4 ± 7.686.4 ± 7.480.6 ± 9.576.5 ± 9.2
225 93.7 ± 3.490.9 ± 3.984.7 ± 7.880.7 ± 8.1
250 94.5 ± 2.792.5 ± 2.785.9 ± 6.882.5 ± 7.2
275 95.6 ± 1.993.8 ± 2.086.9 ± 5.783.5 ± 6.2
300 96.6 ± 1.595.0 ± 1.788.9 ± 5.285.3 ± 5.5
325 97.7 ± 1.096.4 ± 1.291.1 ± 4.386.9 ± 5.0
350 99.3 ± 0.498.4 ± 0.995.7 ± 2.492.6 ± 3.6
375 99.9 ± 0.199.7 ± 0.399.4 ± 0.597.6 ± 1.9
400 100.0 ± 0.099.3 ± 2.3100.0 ± 0.198.5 ± 2.6

Downloads