imagining syntax

← schedopt_bo_r1

r1_c0

done · peak unseen_mismatch 89.1

α schedule

α 1.0746 ×25 α 1.0764 ×25 α 1.0834 ×25 α 1.0997 ×25 α 1.1292 ×25 α 1.1761 ×25 α 1.2447 ×25 α 1.3392 ×25 α 1.4639 ×25 α 1.6234 ×25 α 1.8221 ×25 α 2.0644 ×25 α 2.3549 ×25 α 2.6981 ×25 α 3.0988 ×25 α 3.5614 ×25

direction
ascending
α range
1.0746–3.5614
stages
16

Figures

schedule.png
schedule.png

Results

accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 3.5614

seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition

iterationseen_matchseen_mismatchunseen_matchunseen_mismatch
25 50.4 ± 1.549.8 ± 1.850.0 ± 1.749.9 ± 1.7
50 50.6 ± 1.650.2 ± 1.550.1 ± 1.349.8 ± 1.7
75 50.5 ± 1.249.5 ± 1.850.1 ± 1.149.8 ± 1.5
100 50.2 ± 1.850.2 ± 1.449.8 ± 1.250.1 ± 1.5
125 51.1 ± 1.549.7 ± 1.650.4 ± 2.049.5 ± 2.0
150 50.6 ± 1.750.0 ± 1.549.8 ± 1.849.8 ± 1.6
175 54.8 ± 8.447.8 ± 4.354.5 ± 8.448.1 ± 4.6
200 62.7 ± 18.645.3 ± 10.262.4 ± 18.646.2 ± 11.1
225 69.8 ± 23.142.5 ± 11.970.2 ± 22.844.0 ± 11.8
250 75.6 ± 23.243.9 ± 14.575.1 ± 23.844.3 ± 14.7
275 79.5 ± 22.250.6 ± 19.378.8 ± 22.950.2 ± 19.3
300 86.1 ± 20.557.0 ± 26.885.9 ± 20.556.5 ± 26.2
325 90.3 ± 16.966.2 ± 22.389.3 ± 18.265.5 ± 22.1
350 94.0 ± 13.877.1 ± 24.793.8 ± 13.976.7 ± 23.9
375 96.8 ± 8.982.9 ± 24.396.5 ± 9.382.7 ± 23.5
400 98.3 ± 4.690.4 ± 13.197.8 ± 4.689.1 ± 12.5

Downloads