n-layer_3

done · peak unseen_mismatch 92.1

Configuration

n_layer: 3
n_head: 4
n_embd: 256
base_seed: 42

Figures

Results

param	seen_match	seen_mismatch	unseen_match	unseen_mismatch
0.0	100.0 ± 0.0	29.9 ± 19.7	100.0 ± 0.0	30.2 ± 19.3
0.1	100.0 ± 0.0	16.6 ± 20.2	100.0 ± 0.0	16.8 ± 20.1
0.2	100.0 ± 0.0	23.8 ± 28.4	100.0 ± 0.0	23.2 ± 27.5
0.3	97.0 ± 9.0	5.6 ± 10.8	96.6 ± 10.2	5.4 ± 10.8
0.4	100.0 ± 0.0	20.9 ± 31.2	100.0 ± 0.0	21.2 ± 31.5
0.5	100.0 ± 0.0	19.2 ± 28.5	100.0 ± 0.0	19.0 ± 27.3
0.6	100.0 ± 0.0	28.8 ± 31.2	100.0 ± 0.0	29.3 ± 31.0
0.7	100.0 ± 0.0	12.3 ± 16.8	100.0 ± 0.0	12.6 ± 17.0
0.8	100.0 ± 0.0	18.8 ± 18.1	100.0 ± 0.0	19.0 ± 18.1
0.9	100.0 ± 0.0	13.0 ± 17.5	100.0 ± 0.0	13.2 ± 17.9
1.0	100.0 ± 0.0	40.8 ± 35.0	100.0 ± 0.0	40.8 ± 35.1
1.1	100.0 ± 0.0	35.0 ± 40.4	100.0 ± 0.0	35.0 ± 40.4
1.2	100.0 ± 0.0	54.0 ± 36.6	100.0 ± 0.0	54.0 ± 36.5
1.3	100.0 ± 0.0	78.8 ± 18.5	99.9 ± 0.4	78.9 ± 17.8
1.4	99.9 ± 0.2	85.9 ± 14.1	99.3 ± 1.6	83.4 ± 14.6
1.5	99.8 ± 0.2	94.9 ± 7.9	99.0 ± 1.4	90.8 ± 9.3
1.6	99.5 ± 0.5	93.4 ± 11.9	98.4 ± 1.5	91.3 ± 11.3
1.7	99.4 ± 0.4	98.3 ± 1.1	96.9 ± 1.8	92.1 ± 2.9
1.8	99.5 ± 0.4	95.8 ± 4.6	94.9 ± 3.3	84.9 ± 6.2
1.9	99.1 ± 0.3	98.0 ± 0.8	92.1 ± 2.6	85.4 ± 4.9
2.0	99.1 ± 0.2	97.6 ± 1.7	89.6 ± 2.5	83.2 ± 4.9
2.1	99.3 ± 0.3	97.6 ± 1.5	89.9 ± 4.0	77.4 ± 11.4
2.2	99.3 ± 0.3	98.5 ± 0.8	86.1 ± 3.4	79.2 ± 3.8
2.3	99.2 ± 0.5	97.2 ± 2.6	85.2 ± 3.0	72.3 ± 10.3
2.4	99.2 ± 0.3	97.8 ± 1.5	82.8 ± 2.5	73.5 ± 6.8
2.5	99.4 ± 0.3	98.5 ± 0.8	80.8 ± 2.8	71.6 ± 4.6
2.6	99.4 ± 0.2	98.2 ± 1.0	81.5 ± 4.3	73.8 ± 4.9
2.7	99.6 ± 0.2	99.1 ± 1.0	80.6 ± 2.0	72.6 ± 5.9
2.8	99.4 ± 0.3	99.2 ± 0.4	76.0 ± 5.3	71.2 ± 6.6
2.9	99.6 ± 0.2	98.3 ± 2.0	78.7 ± 2.9	67.0 ± 6.3
3.0	99.7 ± 0.2	98.8 ± 0.9	75.0 ± 3.3	64.7 ± 6.1

n-layer_3

Configuration

Figures

Results

Downloads