imagining syntax

← schedopt_bo_r8

r8_c4

done · peak unseen_mismatch 55.2

α schedule

α 2.8022 ×25 α 2.4463 ×25 α 2.2242 ×25 α 0.6678 ×25 α 0.6215 ×25 α 1.7868 ×25 α 1.6764 ×25 α 1.5762 ×25 α 0.4828 ×25 α 0.455 ×25 α 0.4289 ×25 α 1.2432 ×25 α 1.1719 ×25 α 0.3591 ×25

direction
mixed
α range
0.3591–2.8022
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.3591

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.250.2 ± 1.850.0 ± 1.449.2 ± 1.8
50 51.1 ± 1.750.3 ± 1.849.9 ± 1.249.9 ± 1.6
75 51.4 ± 1.549.7 ± 1.750.4 ± 1.549.3 ± 1.6
100 52.1 ± 3.949.9 ± 2.051.2 ± 2.849.6 ± 1.8
125 57.5 ± 12.047.4 ± 5.155.8 ± 12.447.2 ± 4.7
150 63.3 ± 18.345.5 ± 10.962.2 ± 18.844.6 ± 10.7
175 73.5 ± 20.046.9 ± 13.172.8 ± 20.646.4 ± 12.5
200 84.5 ± 20.555.7 ± 23.584.1 ± 20.755.2 ± 23.1
225 91.1 ± 16.753.1 ± 21.390.6 ± 17.153.5 ± 21.2
250 97.1 ± 9.644.6 ± 25.696.9 ± 10.244.9 ± 25.3
275 100.0 ± 0.237.3 ± 29.0100.0 ± 0.238.1 ± 28.8
300 100.0 ± 0.141.4 ± 31.0100.0 ± 0.141.5 ± 30.8
325 100.0 ± 0.042.2 ± 31.9100.0 ± 0.041.8 ± 31.4
350 100.0 ± 0.044.3 ± 27.3100.0 ± 0.044.6 ± 26.6

Downloads