imagining syntax

← mirror_v1

s3_e0_blk

done · peak unseen_mismatch 93.9

α schedule

α 3.0 ×300 α 2.0 ×300 α 1.0 ×300 α 0.0 ×300

direction
descending
α range
0.0–3.0
stages
4

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.3 ± 2.249.6 ± 0.850.0 ± 1.750.3 ± 1.6
100 55.9 ± 7.453.6 ± 4.652.7 ± 5.750.5 ± 3.7
150 76.3 ± 12.572.0 ± 11.769.1 ± 13.063.1 ± 11.1
200 88.2 ± 4.386.4 ± 4.678.2 ± 8.275.1 ± 6.9
250 90.7 ± 1.689.4 ± 1.679.0 ± 4.976.2 ± 3.6
300 91.8 ± 1.590.3 ± 1.578.3 ± 4.375.5 ± 4.1
350 96.2 ± 0.894.8 ± 1.086.2 ± 3.181.8 ± 3.3
400 96.4 ± 1.294.6 ± 1.487.2 ± 3.381.0 ± 4.4
450 97.0 ± 0.895.8 ± 1.286.4 ± 4.981.1 ± 6.2
500 97.3 ± 0.895.8 ± 1.088.7 ± 2.882.5 ± 5.1
550 97.6 ± 0.896.2 ± 0.789.4 ± 4.082.2 ± 5.1
600 98.0 ± 0.596.5 ± 1.090.7 ± 2.983.7 ± 5.0
650 99.9 ± 0.199.5 ± 0.598.8 ± 0.793.9 ± 4.2
700 100.0 ± 0.199.0 ± 1.599.2 ± 0.792.5 ± 5.2
750 100.0 ± 0.099.3 ± 1.099.3 ± 0.992.5 ± 7.0
800 100.0 ± 0.098.9 ± 1.199.5 ± 0.390.2 ± 8.0
850 100.0 ± 0.099.0 ± 1.299.2 ± 0.989.8 ± 8.4
900 100.0 ± 0.098.3 ± 1.799.2 ± 1.185.0 ± 10.2
950 100.0 ± 0.055.9 ± 33.9100.0 ± 0.051.3 ± 33.3
1000 100.0 ± 0.048.6 ± 33.9100.0 ± 0.046.9 ± 32.9
1050 100.0 ± 0.018.9 ± 13.6100.0 ± 0.121.5 ± 13.5
1100 100.0 ± 0.026.1 ± 17.8100.0 ± 0.128.8 ± 15.9
1150 100.0 ± 0.010.9 ± 4.799.7 ± 0.217.5 ± 8.2
1200 100.0 ± 0.011.4 ± 7.299.7 ± 0.315.7 ± 10.6

Downloads