imagining syntax

← mirror_v1

s5_e0_blk

done · peak unseen_mismatch 94.9

α schedule

α 5.0 ×200 α 4.0 ×200 α 3.0 ×200 α 2.0 ×200 α 1.0 ×200 α 0.0 ×200

direction
descending
α range
0.0–5.0
stages
6

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
50 51.8 ± 2.149.9 ± 1.250.2 ± 1.850.0 ± 1.4
100 59.6 ± 6.456.9 ± 4.652.8 ± 3.751.7 ± 3.0
150 76.5 ± 5.574.3 ± 5.662.2 ± 5.959.1 ± 4.4
200 79.5 ± 1.978.0 ± 2.060.5 ± 3.559.9 ± 3.0
250 82.5 ± 2.481.1 ± 1.763.1 ± 3.661.5 ± 3.6
300 85.3 ± 1.584.0 ± 1.967.1 ± 4.465.2 ± 4.5
350 86.9 ± 2.085.7 ± 1.969.1 ± 5.866.8 ± 5.9
400 86.4 ± 1.684.8 ± 2.267.3 ± 1.964.5 ± 2.8
450 90.3 ± 1.188.5 ± 2.172.6 ± 3.169.8 ± 5.4
500 90.6 ± 1.389.3 ± 1.572.6 ± 5.369.4 ± 5.9
550 91.6 ± 1.689.2 ± 2.074.5 ± 5.470.0 ± 5.0
600 91.9 ± 1.190.2 ± 1.474.8 ± 4.570.7 ± 4.9
650 95.6 ± 1.194.5 ± 1.481.9 ± 3.376.3 ± 4.8
700 97.4 ± 0.796.0 ± 0.587.4 ± 3.581.4 ± 4.8
750 97.4 ± 0.696.0 ± 1.187.3 ± 4.581.3 ± 5.3
800 97.8 ± 0.896.7 ± 0.888.1 ± 3.682.9 ± 4.0
850 100.0 ± 0.199.5 ± 0.499.2 ± 0.594.9 ± 3.8
900 100.0 ± 0.198.9 ± 2.198.8 ± 0.992.4 ± 7.3
950 100.0 ± 0.099.5 ± 0.699.4 ± 0.594.6 ± 4.7
1000 100.0 ± 0.098.8 ± 1.999.5 ± 0.590.5 ± 7.8
1050 100.0 ± 0.070.1 ± 30.5100.0 ± 0.066.5 ± 30.8
1100 100.0 ± 0.059.2 ± 27.0100.0 ± 0.056.0 ± 25.1
1150 100.0 ± 0.025.6 ± 27.199.9 ± 0.126.7 ± 27.0
1200 100.0 ± 0.023.6 ± 25.699.9 ± 0.325.9 ± 24.3

Downloads