imagining syntax

← schedopt_bo_r3

r3_c0

done · peak unseen_mismatch 90.6

α schedule

α 1.868 ×25 α 1.8736 ×25 α 1.8862 ×25 α 1.9064 ×25 α 1.9346 ×25 α 1.9711 ×25 α 2.0163 ×25 α 2.0704 ×25 α 2.1335 ×25 α 2.2059 ×25 α 2.2877 ×25 α 2.3792 ×25 α 2.4804 ×25 α 2.5914 ×25 α 2.7125 ×25 α 2.8437 ×25

direction
ascending
α range
1.868–2.8437
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 2.8437

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.5 ± 1.450.1 ± 1.550.1 ± 1.549.4 ± 1.8
50 50.9 ± 1.950.2 ± 1.350.1 ± 1.350.1 ± 1.3
75 50.9 ± 1.849.6 ± 1.650.4 ± 1.549.5 ± 1.7
100 50.8 ± 2.450.2 ± 1.450.1 ± 1.350.1 ± 1.6
125 52.4 ± 2.249.6 ± 1.651.1 ± 2.249.2 ± 1.8
150 59.6 ± 12.652.2 ± 5.057.1 ± 11.750.3 ± 4.5
175 70.5 ± 18.660.1 ± 11.169.2 ± 18.758.6 ± 10.5
200 79.3 ± 20.767.1 ± 16.778.1 ± 20.965.6 ± 16.2
225 86.5 ± 17.178.0 ± 16.985.2 ± 17.675.9 ± 16.5
250 93.0 ± 12.787.1 ± 14.391.1 ± 13.284.0 ± 14.8
275 95.7 ± 10.291.7 ± 10.993.6 ± 11.488.7 ± 11.3
300 97.3 ± 4.494.6 ± 5.994.7 ± 5.990.6 ± 7.5
325 97.8 ± 1.695.5 ± 2.994.6 ± 4.590.5 ± 6.4
350 97.3 ± 2.195.3 ± 2.992.6 ± 6.088.8 ± 7.4
375 96.3 ± 1.894.5 ± 2.490.7 ± 6.086.9 ± 7.2
400 95.6 ± 1.793.9 ± 2.189.2 ± 5.285.6 ± 5.9

Downloads