imagining syntax

← refine_v1

bursty_K6

done · peak unseen_mismatch 95.8

Referenced by

α schedule

α 3.0 ×150 α 1.0 ×150 α 2.1429 ×150 α 1.0 ×150 α 1.2857 ×150 α 1.0 ×150

direction
mixed
α range
1.0–3.0
stages
6

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 51.1 ± 1.249.8 ± 2.049.8 ± 1.350.4 ± 1.4
50 51.5 ± 1.850.0 ± 1.750.5 ± 1.149.7 ± 1.5
75 52.2 ± 3.349.5 ± 1.650.9 ± 2.749.6 ± 2.7
100 55.6 ± 9.152.2 ± 4.753.4 ± 8.550.4 ± 3.5
125 63.7 ± 13.456.8 ± 10.761.0 ± 13.154.6 ± 9.8
150 78.9 ± 16.470.1 ± 14.274.9 ± 16.866.4 ± 13.4
175 91.2 ± 14.571.0 ± 15.790.3 ± 15.268.9 ± 14.7
200 97.0 ± 9.269.7 ± 19.596.8 ± 9.868.2 ± 19.3
225 99.8 ± 0.765.1 ± 20.299.8 ± 0.764.6 ± 19.2
250 100.0 ± 0.058.4 ± 26.8100.0 ± 0.057.5 ± 26.4
275 100.0 ± 0.061.3 ± 27.0100.0 ± 0.060.9 ± 26.6
300 100.0 ± 0.059.5 ± 31.1100.0 ± 0.059.8 ± 31.0
325 100.0 ± 0.068.7 ± 29.899.9 ± 0.468.3 ± 29.4
350 99.9 ± 0.281.4 ± 22.399.6 ± 1.180.0 ± 22.0
375 99.7 ± 0.693.8 ± 11.899.4 ± 1.492.0 ± 12.3
400 99.7 ± 0.696.1 ± 11.098.5 ± 3.293.7 ± 11.6
450 99.3 ± 1.095.6 ± 10.997.7 ± 3.892.8 ± 11.5
500 100.0 ± 0.194.5 ± 12.799.8 ± 0.593.4 ± 13.3
550 100.0 ± 0.197.2 ± 9.599.8 ± 0.595.8 ± 10.0
600 100.0 ± 0.098.1 ± 2.899.9 ± 0.394.9 ± 7.7
650 100.0 ± 0.195.9 ± 10.799.2 ± 1.892.2 ± 11.9
700 99.9 ± 0.298.2 ± 2.099.3 ± 1.393.8 ± 8.1
750 99.9 ± 0.197.7 ± 3.499.2 ± 1.493.5 ± 7.3
800 100.0 ± 0.198.6 ± 2.899.8 ± 0.494.8 ± 7.7
850 100.0 ± 0.098.1 ± 2.899.8 ± 0.593.8 ± 8.1
900 100.0 ± 0.097.3 ± 4.499.5 ± 0.991.8 ± 10.4

Downloads