imagining syntax

← schedopt_bo_r3

r3_c7

done · peak unseen_mismatch 95.0

α schedule

α 4.1789 ×25 α 4.1717 ×25 α 4.1509 ×25 α 4.1121 ×25 α 4.0516 ×25 α 3.966 ×25 α 3.8525 ×25 α 3.7082 ×25 α 3.5307 ×25 α 3.3176 ×25 α 3.0666 ×25 α 2.7755 ×25 α 2.4423 ×25 α 2.0649 ×25 α 1.6415 ×25 α 1.1702 ×25

direction
descending
α range
1.1702–4.1789
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.1702

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.250.5 ± 1.649.9 ± 1.549.5 ± 1.8
50 51.5 ± 1.550.5 ± 1.749.9 ± 1.049.9 ± 1.6
75 52.8 ± 2.250.2 ± 1.850.7 ± 1.749.3 ± 1.5
100 59.5 ± 7.857.0 ± 5.553.5 ± 4.751.1 ± 3.2
125 71.1 ± 10.968.1 ± 10.259.0 ± 9.956.9 ± 8.2
150 78.0 ± 6.475.9 ± 6.364.4 ± 7.961.6 ± 7.0
175 82.1 ± 4.480.3 ± 3.766.6 ± 8.163.9 ± 7.7
200 83.4 ± 3.381.3 ± 3.165.9 ± 6.163.8 ± 5.9
225 84.6 ± 2.782.7 ± 2.666.7 ± 5.464.5 ± 5.5
250 85.7 ± 2.584.2 ± 2.467.9 ± 4.666.2 ± 4.7
275 87.8 ± 2.586.3 ± 2.270.2 ± 5.468.2 ± 5.2
300 90.5 ± 2.488.9 ± 2.074.1 ± 5.771.6 ± 5.7
325 92.4 ± 1.890.5 ± 1.576.5 ± 5.074.0 ± 4.3
350 95.3 ± 1.493.7 ± 1.282.3 ± 4.679.3 ± 4.1
375 97.5 ± 0.996.4 ± 1.188.4 ± 3.484.9 ± 3.8
400 99.7 ± 0.399.2 ± 0.797.5 ± 1.795.0 ± 2.9

Downloads