imagining syntax

← schedopt_calib

lin_down

done · peak unseen_mismatch 97.2

α schedule

α 4.8438 ×25 α 4.5312 ×25 α 4.2188 ×25 α 3.9062 ×25 α 3.5938 ×25 α 3.2812 ×25 α 2.9688 ×25 α 2.6562 ×25 α 2.3438 ×25 α 2.0312 ×25 α 1.7188 ×25 α 1.4062 ×25 α 1.0938 ×25 α 0.7812 ×25 α 0.4688 ×25 α 0.1562 ×25

direction
descending
α range
0.1562–4.8438
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.1562

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.4 ± 1.950.0 ± 1.650.1 ± 2.150.1 ± 1.6
50 51.9 ± 2.050.7 ± 1.350.4 ± 2.050.0 ± 1.9
75 53.5 ± 2.751.1 ± 2.350.6 ± 2.449.0 ± 1.4
100 63.4 ± 7.959.0 ± 6.655.4 ± 6.252.6 ± 3.5
125 76.8 ± 9.672.7 ± 8.864.7 ± 10.460.3 ± 8.6
150 83.0 ± 4.579.6 ± 4.968.2 ± 7.064.5 ± 6.0
175 84.9 ± 3.982.3 ± 4.069.2 ± 7.066.0 ± 5.7
200 88.2 ± 2.885.9 ± 2.672.3 ± 5.868.8 ± 4.5
225 91.4 ± 2.489.1 ± 2.177.4 ± 5.074.0 ± 4.8
250 94.4 ± 1.692.6 ± 1.681.5 ± 5.578.6 ± 4.8
275 96.7 ± 1.195.4 ± 1.387.3 ± 4.483.7 ± 4.6
300 98.7 ± 0.997.6 ± 1.192.5 ± 3.289.1 ± 3.7
325 99.8 ± 0.399.2 ± 0.697.8 ± 1.595.1 ± 3.7
350 100.0 ± 0.099.5 ± 2.199.5 ± 0.697.2 ± 5.5
375 100.0 ± 0.099.0 ± 2.999.9 ± 0.196.9 ± 6.5
400 100.0 ± 0.087.8 ± 16.0100.0 ± 0.084.0 ± 17.4

Downloads