Model | baseline | Æøå | Lowercase | 5 sentences | 10 sentences | Abbreviated | Danish | Muslim | Female | Male | 2% | 5% | 15% |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
DaCy large | 85.6 | 83.5 | 69.7 | 86.5 | 86.5 | 80.1 | 86.2 (0.6)* | 86.0 (0.5) | 86.2 (0.5) | 86.2 (0.4) | 82.0 (1.2)* | 76.9 (1.3)* | 61.3 (1.6)* |
DaCy medium | 79.7 | 73.1 | 79.5 | 80.9 | 80.4 | 76.3 | 80.3 (0.5)* | 77.9 (0.8)* | 80.3 (0.4) | 80.2 (0.7) | 65.5 (1.7)* | 50.0 (1.6)* | 25.8 (1.3)* |
DaCy small | 77.0 | 74.7 | 48.0 | 77.0 | 78.2 | 69.4 | 76.5 (0.9) | 75.7 (0.7)* | 76.7 (0.8) | 76.6 (0.7) | 70.7 (1.6)* | 62.1 (1.5)* | 41.3 (1.6)* |
DaNLP BERT | 83.2 | 78.6 | 83.1 | 78.6 | 61.9 | 78.1 | 82.9 (0.6) | 81.0 (1.0)* | 83.1 (0.5) | 83.0 (0.7) | 72.6 (1.2)* | 60.9 (1.7)* | 37.0 (1.5)* |
Flair | 81.1 | 80.2 | 24.4 | 81.0 | 80.9 | 74.9 | 81.2 (0.7) | 79.8 (0.7)* | 81.4 (0.5) | 81.5 (0.5) | 78.3 (0.9)* | 73.5 (1.5)* | 56.3 (1.7)* |
NERDA | 80.9 | 74.8 | 80.7 | 73.7 | 53.8 | 76.4 | 80.0 (1.1)* | 78.1 (1.2)* | 80.2 (0.8) | 80.0 (0.8) | 70.7 (1.4)* | 57.5 (1.4)* | 31.1 (1.6)* |
Polyglot | 65.3 | 61.4 | 55.3 | 64.8 | 64.2 | 40.2 | 63.1 (1.2)* | 41.8 (0.7)* | 61.2 (1.2)* | 64.8 (1.2)* | 57.4 (0.9)* | 46.9 (1.9)* | 24.7 (1.9)* |
SpaCy large | 78.6 | 75.4 | 5.7 | 78.8 | 78.8 | 78.0 | 79.5 (0.6)* | 71.6 (1.1)* | 79.8 (0.5) | 79.4 (0.5) | 72.1 (1.0)* | 63.3 (1.5)* | 44.9 (1.8)* |
SpaCy medium | 76.0 | 74.7 | 9.7 | 76.5 | 76.8 | 76.0 | 78.2 (0.7)* | 69.2 (1.4)* | 78.2 (0.7) | 78.5 (0.8) | 70.5 (1.3)* | 64.2 (1.5)* | 46.9 (1.6)* |
SpaCy small | 68.6 | 66.9 | 4.8 | 68.0 | 68.0 | 63.8 | 62.5 (1.6)* | 57.8 (1.4)* | 63.0 (1.1) | 63.3 (0.9) | 65.4 (0.7)* | 60.5 (1.5)* | 45.9 (1.6)* |