imagining syntax

← schedopt_confirm_v2

phi4star

done · peak unseen_mismatch 99.2

Referenced by

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.0634 ×25 α 1.0536 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.9043 ×25 α 0.8215 ×25 α 0.7122 ×25 α 3.084 ×25 α 2.1282 ×25 α 0.1755 ×25

direction
mixed
α range
0.1755–5.0
stages
14

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.1755

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.1 ± 1.550.1 ± 1.550.1 ± 1.750.0 ± 1.6
50 51.6 ± 1.950.1 ± 1.750.2 ± 1.549.9 ± 1.5
75 53.6 ± 3.351.7 ± 2.450.9 ± 2.449.9 ± 1.6
100 57.0 ± 8.252.5 ± 4.453.7 ± 7.750.6 ± 3.5
125 68.2 ± 15.755.3 ± 9.165.3 ± 16.053.4 ± 8.4
150 85.8 ± 14.475.2 ± 13.982.2 ± 16.170.9 ± 14.0
175 91.0 ± 8.586.2 ± 9.085.5 ± 11.479.6 ± 10.9
200 90.6 ± 5.987.9 ± 5.883.0 ± 9.479.0 ± 9.1
225 99.0 ± 3.397.5 ± 5.198.3 ± 4.596.1 ± 6.6
250 99.9 ± 0.497.8 ± 6.699.8 ± 0.597.0 ± 7.2
275 100.0 ± 0.096.9 ± 9.5100.0 ± 0.196.3 ± 10.0
300 96.9 ± 2.394.1 ± 4.391.5 ± 6.085.9 ± 7.8
325 98.0 ± 1.195.7 ± 2.393.8 ± 3.588.6 ± 5.2
350 100.0 ± 0.099.3 ± 5.2100.0 ± 0.099.2 ± 5.1

Downloads