n-embd_128

done · peak unseen_mismatch 89.2

Configuration

n_layer: 2
n_head: 4
n_embd: 128
base_seed: 42

Figures

Results

param	seen_match	seen_mismatch	unseen_match	unseen_mismatch
0.0	100.0 ± 0.0	11.8 ± 16.2	100.0 ± 0.0	11.5 ± 15.9
0.1	100.0 ± 0.0	6.1 ± 10.2	100.0 ± 0.0	6.0 ± 10.3
0.2	100.0 ± 0.0	6.0 ± 14.8	100.0 ± 0.0	6.0 ± 14.8
0.3	100.0 ± 0.0	6.5 ± 14.2	100.0 ± 0.0	6.7 ± 14.6
0.4	100.0 ± 0.0	0.1 ± 0.3	100.0 ± 0.0	0.2 ± 0.4
0.5	100.0 ± 0.0	6.9 ± 15.1	100.0 ± 0.0	7.0 ± 15.0
0.6	100.0 ± 0.0	12.4 ± 18.7	100.0 ± 0.0	12.4 ± 18.2
0.7	100.0 ± 0.0	7.8 ± 11.7	100.0 ± 0.0	7.7 ± 11.5
0.8	100.0 ± 0.0	11.8 ± 14.5	100.0 ± 0.0	12.3 ± 14.8
0.9	100.0 ± 0.0	20.9 ± 31.8	100.0 ± 0.0	21.2 ± 31.7
1.0	100.0 ± 0.0	29.3 ± 26.7	100.0 ± 0.0	28.9 ± 26.4
1.1	100.0 ± 0.0	30.8 ± 29.1	100.0 ± 0.0	31.8 ± 29.1
1.2	100.0 ± 0.0	52.7 ± 40.5	100.0 ± 0.0	52.4 ± 39.7
1.3	100.0 ± 0.1	95.1 ± 4.7	100.0 ± 0.1	89.2 ± 5.9
1.4	99.9 ± 0.2	88.2 ± 15.1	99.8 ± 0.4	84.7 ± 14.4
1.5	99.9 ± 0.2	94.2 ± 9.2	98.7 ± 1.5	88.4 ± 9.6
1.6	99.7 ± 0.4	88.1 ± 23.0	98.0 ± 2.9	79.0 ± 19.9
1.7	99.6 ± 0.3	96.8 ± 1.2	96.3 ± 3.0	85.2 ± 6.1
1.8	99.3 ± 0.5	94.1 ± 3.9	95.9 ± 3.3	83.1 ± 2.6
1.9	99.2 ± 0.5	96.5 ± 3.1	92.6 ± 3.6	83.4 ± 3.4
2.0	99.2 ± 0.3	97.9 ± 0.7	92.1 ± 3.0	83.2 ± 5.1
2.1	99.2 ± 0.3	97.7 ± 0.8	89.7 ± 2.7	81.9 ± 3.7
2.2	99.0 ± 0.6	97.4 ± 1.3	87.2 ± 2.1	76.6 ± 4.4
2.3	99.2 ± 0.3	98.0 ± 0.8	84.8 ± 2.6	73.5 ± 6.5
2.4	99.3 ± 0.4	98.1 ± 0.7	84.8 ± 5.2	75.0 ± 4.7
2.5	99.2 ± 0.3	98.1 ± 0.6	80.8 ± 4.7	71.5 ± 5.3
2.6	99.0 ± 0.3	98.2 ± 0.7	81.6 ± 4.1	72.0 ± 6.8
2.7	99.3 ± 0.3	98.9 ± 0.3	80.0 ± 4.2	73.3 ± 5.3
2.8	99.4 ± 0.2	98.9 ± 0.5	78.5 ± 2.5	71.7 ± 2.3
2.9	99.3 ± 0.2	98.9 ± 0.6	77.0 ± 5.0	69.7 ± 4.6
3.0	99.6 ± 0.2	99.0 ± 0.5	78.3 ± 2.7	69.3 ± 1.6

n-embd_128

Configuration

Figures

Results

Downloads