cds
done · peak unseen_mismatch 81.0
Referenced by
α schedule
α 1.46 ×150 α 1.4 ×150 α 1.44 ×150 α 1.38 ×150 α 1.37 ×150 α 1.28 ×150 α 1.23 ×150 α 1.25 ×150
Figures
Results
accuracy by training iteration, mean ± sd over seeds · schedule ends at α = 1.25
seen_* probed at reference α = 1.4 · unseen_* = held-out pairings, uniform (α-independent) · 1000 pairs per condition
| iteration | seen_match | seen_mismatch | unseen_match | unseen_mismatch |
|---|---|---|---|---|
| 150 | 56.4 ± 14.6 | 48.1 ± 4.3 | 57.5 ± 14.4 | 48.4 ± 4.2 |
| 300 | 96.7 ± 10.0 | 30.7 ± 21.0 | 96.3 ± 11.2 | 30.3 ± 20.6 |
| 450 | 100.0 ± 0.0 | 34.7 ± 30.4 | 100.0 ± 0.0 | 34.8 ± 30.2 |
| 600 | 100.0 ± 0.0 | 45.9 ± 30.0 | 100.0 ± 0.0 | 46.9 ± 29.9 |
| 750 | 100.0 ± 0.0 | 65.9 ± 34.5 | 99.9 ± 0.4 | 64.8 ± 33.5 |
| 900 | 100.0 ± 0.0 | 76.1 ± 30.8 | 99.9 ± 0.2 | 74.3 ± 29.6 |
| 1050 | 100.0 ± 0.1 | 81.0 ± 30.3 | 99.3 ± 1.4 | 78.1 ± 28.7 |
| 1200 | 99.9 ± 0.1 | 85.4 ± 26.2 | 99.1 ± 1.7 | 81.0 ± 25.6 |