imagining syntax

← anchor_v1

fixed_16

done · peak unseen_mismatch 91.5

Referenced by

α schedule

α 1.6 ×900

direction
constant
α range
1.6–1.6
stages
1

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.6

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.7 ± 1.649.4 ± 1.649.9 ± 1.950.5 ± 1.4
50 51.2 ± 1.749.7 ± 1.849.7 ± 1.649.6 ± 1.7
75 51.4 ± 1.949.9 ± 1.350.6 ± 1.849.7 ± 1.4
100 52.6 ± 3.049.6 ± 2.051.3 ± 2.749.5 ± 1.9
125 56.7 ± 11.147.5 ± 6.355.6 ± 11.247.4 ± 6.6
150 64.9 ± 18.144.6 ± 12.063.9 ± 18.444.9 ± 11.7
175 73.5 ± 21.545.3 ± 14.173.2 ± 21.844.7 ± 13.8
200 84.7 ± 20.244.2 ± 17.984.4 ± 20.643.9 ± 17.6
225 90.7 ± 17.537.3 ± 22.590.4 ± 17.737.4 ± 22.1
250 94.6 ± 14.333.1 ± 24.294.3 ± 15.132.9 ± 23.6
275 97.4 ± 9.038.9 ± 25.097.1 ± 9.738.8 ± 24.9
300 99.3 ± 3.337.4 ± 32.099.3 ± 3.437.9 ± 31.5
325 100.0 ± 0.041.9 ± 34.2100.0 ± 0.041.9 ± 33.9
350 100.0 ± 0.046.6 ± 31.9100.0 ± 0.046.3 ± 31.6
375 100.0 ± 0.050.6 ± 35.6100.0 ± 0.050.4 ± 35.0
400 100.0 ± 0.057.9 ± 35.899.9 ± 0.357.3 ± 35.1
450 100.0 ± 0.164.9 ± 35.999.9 ± 0.364.7 ± 35.3
500 100.0 ± 0.074.6 ± 33.199.9 ± 0.374.3 ± 32.7
550 99.9 ± 0.379.2 ± 28.599.9 ± 0.478.3 ± 28.2
600 99.9 ± 0.184.2 ± 25.999.7 ± 1.183.2 ± 25.2
650 99.9 ± 0.390.0 ± 22.899.5 ± 1.088.0 ± 22.7
700 99.8 ± 0.392.2 ± 16.798.9 ± 1.789.4 ± 16.5
750 99.7 ± 0.593.9 ± 12.998.9 ± 1.791.2 ± 13.0
800 99.7 ± 0.494.6 ± 11.398.6 ± 1.691.5 ± 11.9
850 99.5 ± 0.594.0 ± 16.198.0 ± 2.390.1 ± 16.0
900 99.4 ± 0.693.4 ± 17.197.9 ± 2.188.8 ± 17.1

Downloads