n-layer_4

done · peak unseen_mismatch 86.0

Configuration

n_layer: 4
n_head: 4
n_embd: 256
base_seed: 42

Figures

Results

param	seen_match	seen_mismatch	unseen_match	unseen_mismatch
0.0	89.6 ± 19.6	15.5 ± 22.0	89.7 ± 19.4	15.7 ± 22.8
0.1	93.5 ± 14.5	11.6 ± 15.2	93.3 ± 14.8	11.8 ± 14.8
0.2	95.1 ± 14.7	11.6 ± 16.2	95.3 ± 14.2	11.8 ± 16.9
0.3	100.0 ± 0.0	8.6 ± 16.1	100.0 ± 0.0	8.4 ± 16.3
0.4	89.9 ± 20.1	14.8 ± 20.6	90.5 ± 19.1	14.3 ± 20.1
0.5	100.0 ± 0.0	11.7 ± 14.5	100.0 ± 0.0	11.2 ± 13.7
0.6	95.4 ± 13.8	29.5 ± 18.4	95.3 ± 14.2	30.8 ± 19.1
0.7	100.0 ± 0.0	18.1 ± 20.2	100.0 ± 0.0	17.8 ± 20.6
0.8	90.3 ± 19.4	26.8 ± 30.0	89.5 ± 21.0	26.9 ± 29.9
0.9	100.0 ± 0.0	13.7 ± 16.4	100.0 ± 0.0	13.9 ± 17.4
1.0	95.0 ± 15.0	17.5 ± 21.9	95.1 ± 14.7	18.5 ± 22.2
1.1	100.0 ± 0.0	28.4 ± 21.0	100.0 ± 0.0	27.9 ± 20.8
1.2	100.0 ± 0.0	23.8 ± 27.6	100.0 ± 0.0	23.8 ± 27.0
1.3	100.0 ± 0.0	37.6 ± 33.4	100.0 ± 0.0	38.8 ± 33.7
1.4	94.9 ± 15.2	32.7 ± 29.1	94.9 ± 15.3	33.0 ± 29.5
1.5	100.0 ± 0.0	64.0 ± 37.0	100.0 ± 0.0	63.0 ± 36.2
1.6	99.8 ± 0.3	56.6 ± 39.6	99.2 ± 1.3	54.3 ± 37.7
1.7	99.9 ± 0.1	77.5 ± 21.9	99.7 ± 0.8	75.5 ± 20.6
1.8	99.6 ± 0.3	89.8 ± 21.1	96.9 ± 2.8	84.7 ± 20.1
1.9	99.5 ± 0.4	91.1 ± 21.5	96.1 ± 3.3	83.9 ± 21.1
2.0	99.5 ± 0.4	94.3 ± 5.7	94.1 ± 4.8	85.6 ± 7.0
2.1	99.0 ± 1.1	94.9 ± 6.6	92.0 ± 6.1	86.0 ± 5.9
2.2	99.2 ± 0.4	93.2 ± 13.1	90.0 ± 4.2	79.5 ± 12.0
2.3	99.4 ± 0.3	94.7 ± 10.5	90.7 ± 4.4	80.4 ± 8.4
2.4	99.1 ± 0.2	97.1 ± 2.7	85.2 ± 3.2	75.8 ± 6.1
2.5	98.3 ± 3.3	97.3 ± 3.4	80.7 ± 8.1	76.0 ± 9.3
2.6	99.1 ± 0.4	98.1 ± 0.7	81.2 ± 3.7	74.8 ± 2.0
2.7	99.5 ± 0.2	98.0 ± 2.5	80.2 ± 4.7	72.3 ± 7.0
2.8	99.2 ± 0.3	97.7 ± 1.2	77.4 ± 3.7	66.6 ± 6.2
2.9	99.3 ± 0.3	97.6 ± 2.2	78.0 ± 6.3	69.9 ± 12.4
3.0	99.5 ± 0.2	96.5 ± 2.5	75.2 ± 2.7	60.0 ± 9.3

n-layer_4

Configuration

Figures

Results

Downloads