n-layer_1

done · peak unseen_mismatch 90.7

Configuration

n_layer: 1
n_head: 4
n_embd: 256
base_seed: 42

Figures

Results

param	seen_match	seen_mismatch	unseen_match	unseen_mismatch
0.0	100.0 ± 0.0	17.3 ± 15.5	100.0 ± 0.0	18.1 ± 15.1
0.1	100.0 ± 0.0	15.6 ± 20.0	100.0 ± 0.0	14.8 ± 19.6
0.2	100.0 ± 0.0	3.0 ± 4.3	100.0 ± 0.0	4.0 ± 4.7
0.3	100.0 ± 0.0	24.9 ± 29.4	100.0 ± 0.0	24.1 ± 29.4
0.4	100.0 ± 0.0	17.5 ± 17.3	100.0 ± 0.0	18.2 ± 16.9
0.5	100.0 ± 0.0	16.7 ± 21.1	100.0 ± 0.0	16.4 ± 21.3
0.6	100.0 ± 0.0	12.3 ± 14.0	100.0 ± 0.0	14.3 ± 15.1
0.7	100.0 ± 0.0	19.6 ± 17.7	100.0 ± 0.0	19.1 ± 17.5
0.8	100.0 ± 0.0	65.6 ± 24.9	100.0 ± 0.0	64.7 ± 24.8
0.9	100.0 ± 0.0	89.3 ± 16.3	100.0 ± 0.0	88.0 ± 16.1
1.0	100.0 ± 0.0	88.3 ± 11.0	99.6 ± 0.8	83.4 ± 12.7
1.1	99.9 ± 0.1	95.3 ± 6.0	99.4 ± 0.6	89.2 ± 11.9
1.2	99.9 ± 0.2	93.8 ± 8.8	98.8 ± 1.0	86.0 ± 15.5
1.3	99.9 ± 0.1	98.2 ± 1.1	96.9 ± 1.2	87.9 ± 4.9
1.4	99.9 ± 0.2	98.0 ± 1.2	95.8 ± 2.6	87.3 ± 7.2
1.5	99.8 ± 0.1	98.9 ± 1.4	96.0 ± 1.3	88.2 ± 8.1
1.6	99.8 ± 0.2	99.2 ± 0.6	95.1 ± 1.8	89.6 ± 5.4
1.7	99.8 ± 0.2	99.2 ± 0.4	94.3 ± 1.9	87.8 ± 4.6
1.8	99.7 ± 0.1	99.5 ± 0.3	93.5 ± 2.2	90.7 ± 3.3
1.9	99.7 ± 0.2	99.1 ± 0.5	91.2 ± 3.2	85.1 ± 3.6
2.0	99.7 ± 0.2	99.2 ± 0.4	91.4 ± 2.5	84.1 ± 6.1
2.1	99.8 ± 0.1	99.4 ± 0.3	91.9 ± 2.4	87.7 ± 4.3
2.2	99.8 ± 0.2	99.3 ± 0.5	90.2 ± 2.9	84.0 ± 7.7
2.3	99.7 ± 0.2	99.5 ± 0.3	88.6 ± 2.9	85.0 ± 2.9
2.4	99.8 ± 0.1	99.6 ± 0.2	88.7 ± 2.1	85.5 ± 3.3
2.5	99.8 ± 0.1	99.6 ± 0.3	87.0 ± 3.4	83.3 ± 4.3
2.6	99.7 ± 0.1	99.6 ± 0.2	87.7 ± 3.7	84.4 ± 5.2
2.7	99.8 ± 0.1	99.7 ± 0.2	85.3 ± 2.6	81.9 ± 3.1
2.8	99.9 ± 0.2	99.8 ± 0.1	84.9 ± 2.5	82.7 ± 2.8
2.9	99.8 ± 0.1	99.7 ± 0.1	85.0 ± 3.2	82.5 ± 3.7
3.0	99.8 ± 0.2	99.8 ± 0.1	83.9 ± 3.0	81.7 ± 3.0

n-layer_1

Configuration

Figures

Results

Downloads