imagining syntax

← efficiency_v1

ann_burst_cycle

done · peak unseen_mismatch 96.8

Referenced by

α schedule

α 3.0 ×150 α 1.0 ×150 α 2.1429 ×150 α 1.0 ×150 α 1.2857 ×150 α 1.0 ×150 α 1.4 ×150 α 1.0 ×150 α 1.4 ×150 α 1.0 ×150 α 1.4 ×150 α 1.0 ×150 α 1.4 ×150 α 1.0 ×150 α 1.4 ×150 α 1.0 ×150

direction
mixed
α range
1.0–3.0
stages
16

Figures

schedule.png
schedule.png
trajectory.png
trajectory.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.0

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
150 70.1 ± 16.162.2 ± 12.367.1 ± 15.660.3 ± 10.7
300 100.0 ± 0.040.7 ± 27.0100.0 ± 0.040.8 ± 27.3
450 99.8 ± 0.393.8 ± 15.199.5 ± 0.993.0 ± 14.8
600 100.0 ± 0.097.7 ± 3.1100.0 ± 0.096.8 ± 3.2
750 100.0 ± 0.097.2 ± 4.199.7 ± 0.594.6 ± 5.9
900 100.0 ± 0.098.1 ± 2.599.7 ± 0.994.6 ± 5.6
1050 99.9 ± 0.197.2 ± 2.498.7 ± 1.390.9 ± 6.0
1200 100.0 ± 0.096.0 ± 3.599.8 ± 0.485.9 ± 8.9
1350 99.8 ± 0.396.2 ± 3.497.9 ± 1.284.0 ± 7.6
1500 100.0 ± 0.093.7 ± 3.599.8 ± 0.380.8 ± 10.9
1650 99.8 ± 0.194.6 ± 3.796.6 ± 2.176.2 ± 11.3
1800 100.0 ± 0.091.3 ± 8.099.6 ± 0.475.5 ± 13.8
1950 99.9 ± 0.195.0 ± 5.295.3 ± 4.076.7 ± 12.9
2100 100.0 ± 0.089.9 ± 10.298.9 ± 1.971.6 ± 18.8
2250 99.8 ± 0.393.6 ± 4.094.2 ± 3.970.6 ± 13.3
2400 100.0 ± 0.085.8 ± 10.598.5 ± 1.864.8 ± 14.1

Downloads