imagining syntax

← schedopt_bo_r3

r3_c4

done · peak unseen_mismatch 97.7

α schedule

α 3.5999 ×25 α 3.5832 ×25 α 3.5451 ×25 α 3.4832 ×25 α 3.3957 ×25 α 3.2812 ×25 α 3.1388 ×25 α 2.9672 ×25 α 2.7658 ×25 α 2.5338 ×25 α 2.2704 ×25 α 1.975 ×25 α 1.6469 ×25 α 1.2858 ×25 α 0.8909 ×25 α 0.4619 ×25

direction
descending
α range
0.4619–3.5999
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 0.4619

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.9 ± 1.450.4 ± 1.649.9 ± 1.449.5 ± 1.9
50 51.2 ± 1.450.3 ± 1.649.9 ± 1.150.0 ± 1.6
75 52.3 ± 2.250.0 ± 1.650.6 ± 1.549.4 ± 1.4
100 57.0 ± 6.954.9 ± 4.351.9 ± 3.650.2 ± 1.7
125 68.7 ± 11.265.1 ± 10.059.1 ± 9.956.5 ± 7.5
150 79.2 ± 8.476.4 ± 8.366.7 ± 9.663.4 ± 8.7
175 85.4 ± 4.282.5 ± 4.271.3 ± 9.568.1 ± 9.1
200 87.2 ± 3.684.9 ± 3.671.5 ± 7.569.1 ± 8.0
225 89.0 ± 2.986.6 ± 2.773.6 ± 6.671.1 ± 6.8
250 90.7 ± 2.288.8 ± 2.075.4 ± 5.972.7 ± 5.9
275 93.2 ± 1.891.5 ± 1.679.0 ± 5.476.8 ± 4.8
300 95.4 ± 1.593.8 ± 1.583.7 ± 5.080.5 ± 4.9
325 97.3 ± 0.996.2 ± 1.288.8 ± 4.685.3 ± 5.6
350 99.5 ± 0.498.9 ± 0.496.6 ± 1.793.9 ± 2.3
375 99.9 ± 0.199.8 ± 0.299.2 ± 0.697.7 ± 1.5
400 100.0 ± 0.097.2 ± 5.1100.0 ± 0.194.5 ± 8.6

Downloads