imagining syntax

← schedopt_bo_r4

r4_c7

done · peak unseen_mismatch 99.1

α schedule

α 3.1128 ×25 α 3.0863 ×25 α 3.0348 ×25 α 2.9587 ×25 α 2.8585 ×25 α 2.7343 ×25 α 2.5864 ×25 α 2.4148 ×25 α 2.2199 ×25 α 2.0016 ×25 α 1.7601 ×25 α 1.4955 ×25 α 1.2078 ×25 α 0.8972 ×25 α 0.5636 ×25 α 0.2073 ×25

direction
descending
α range
0.2073–3.1128
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.2073

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.8 ± 1.250.3 ± 1.750.0 ± 1.549.5 ± 1.9
50 51.3 ± 1.550.4 ± 1.749.9 ± 1.349.9 ± 1.8
75 52.1 ± 1.950.1 ± 1.750.4 ± 1.449.6 ± 1.6
100 55.3 ± 6.753.0 ± 3.252.1 ± 3.650.0 ± 1.5
125 65.9 ± 12.761.0 ± 10.458.6 ± 11.454.6 ± 7.4
150 76.8 ± 13.073.0 ± 12.468.9 ± 13.764.7 ± 12.5
175 85.6 ± 9.782.5 ± 9.375.2 ± 13.470.9 ± 12.2
200 90.9 ± 6.888.4 ± 6.681.2 ± 10.077.1 ± 10.3
225 94.1 ± 3.191.8 ± 3.584.5 ± 6.980.7 ± 7.6
250 95.3 ± 1.893.4 ± 2.286.5 ± 5.183.0 ± 6.1
275 97.4 ± 1.195.8 ± 1.390.3 ± 4.986.7 ± 5.1
300 98.5 ± 0.997.4 ± 1.194.0 ± 3.690.5 ± 4.1
325 99.6 ± 0.398.8 ± 0.797.0 ± 2.394.1 ± 3.1
350 100.0 ± 0.199.6 ± 0.499.5 ± 0.798.0 ± 1.7
375 100.0 ± 0.099.8 ± 0.4100.0 ± 0.199.1 ± 1.4
400 100.0 ± 0.094.3 ± 14.1100.0 ± 0.092.0 ± 16.1

Downloads