imagining syntax

← schedopt_v4

phi4star_ext

done · peak unseen_mismatch 95.2

α schedule

α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 1.063 ×25 α 1.054 ×25 α 5.0 ×25 α 5.0 ×25 α 5.0 ×25 α 0.9043 ×25 α 0.8215 ×25 α 0.7122 ×25 α 3.084 ×25 α 2.128 ×25 α 0.1755 ×25 α 0.1755 ×50

direction
mixed
α range
0.1755–5.0
stages
15

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.1755

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
100 56.3 ± 6.751.7 ± 4.253.3 ± 6.249.3 ± 2.1
110 59.1 ± 9.851.8 ± 3.856.0 ± 9.549.4 ± 1.8
120 62.0 ± 14.452.7 ± 5.559.9 ± 14.650.6 ± 4.1
130 66.3 ± 17.555.5 ± 9.064.2 ± 17.354.3 ± 8.0
140 72.4 ± 17.761.7 ± 13.969.4 ± 17.559.4 ± 12.1
150 79.7 ± 15.067.2 ± 13.675.1 ± 16.664.2 ± 12.5
160 84.9 ± 13.177.1 ± 13.280.4 ± 14.772.5 ± 13.8
170 87.1 ± 10.679.9 ± 10.081.8 ± 12.573.9 ± 11.0
180 88.9 ± 7.884.3 ± 7.682.2 ± 11.677.0 ± 10.4
190 90.2 ± 5.987.0 ± 5.382.8 ± 9.578.1 ± 8.8
200 89.3 ± 5.386.4 ± 5.581.7 ± 8.577.3 ± 8.5
210 91.6 ± 5.889.1 ± 5.985.3 ± 7.681.3 ± 7.5
220 97.6 ± 2.595.3 ± 3.095.5 ± 3.891.7 ± 5.0
230 98.6 ± 1.794.7 ± 3.697.1 ± 3.591.1 ± 4.9
240 99.8 ± 0.297.7 ± 1.699.2 ± 0.695.2 ± 1.4

Downloads