Papers › Neural Architectures for Nested NER through Linearization

Neural Architectures for Nested NER through Linearization

19 Aug 2019ACL 2019 7arXiv:1908.06926archive 2025-07-28

Jana Straková, Milan Straka, Jan Hajič

We propose two neural network architectures for nested named entity recognition (NER), a setting in which named entities may overlap and also be labeled with more than one label. We encode the nested labels using a linearized scheme. In our first proposed approach, the nested labels are modeled as multilabels corresponding to the Cartesian product of the nested labels in a standard LSTM-CRF architecture. In the second one, the nested NER is viewed as a sequence-to-sequence problem, in which the input sequence consists of the tokens and output sequence of the labels, using hard attention on the word whose label is being predicted. The proposed methods outperform the nested NER state of the art on four corpora: ACE-2004, ACE-2005, GENIA and Czech CNEC. We also enrich our architectures with the recently published contextual embeddings: ELMo, BERT and Flair, reaching further improvements for the four nested entity corpora. In addition, we report flat NER state-of-the-art results for CoNLL-2002 Dutch and Spanish and for CoNLL-2003 English.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Hard AttentionNERNamed Entity RecognitionNamed Entity Recognition (NER)Nested Mention RecognitionNested Named Entity Recognitionnamed-entity-recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) ACE 2004 seq2seq+BERT+Flair F1 84.40 #6 of 9 Archive leaderboard report
Named Entity Recognition (NER) ACE 2004 seq2seq+BERT+Flair Multi-Task Supervision n #6 of 9 Archive leaderboard report
Named Entity Recognition (NER) ACE 2005 seq2seq+BERT+Flair F1 84.33 #13 of 20 Archive leaderboard report
Named Entity Recognition (NER) CoNLL 2002 (Dutch) Straková et al., 2019 F1 92.7 #6 of 6 Archive leaderboard report
Named Entity Recognition (NER) CoNLL 2002 (Spanish) Straková et al., 2019 F1 88.8 #5 of 6 Archive leaderboard report
Named Entity Recognition (NER) CoNLL 2003 (English) LSTM-CRF+ELMo+BERT+Flair F1 93.38 #23 of 73 Archive leaderboard report
Named Entity Recognition (NER) CoNLL 2003 (German) Straková et al., 2019 F1 85.1 #6 of 6 Archive leaderboard report
Named Entity Recognition (NER) GENIA seq2seq+BERT+Flair F1 78.31 #4 of 14 Archive leaderboard report
Nested Mention Recognition ACE 2004 seq2seq+BERT+Flair F1 84.40 #4 of 7 Archive leaderboard report
Nested Mention Recognition ACE 2005 seq2seq+BERT+Flair F1 84.33 #3 of 10 Archive leaderboard report
Nested Named Entity Recognition ACE 2004 seq2seq+BERT+Flair F1 84.40 #20 of 24 Archive leaderboard report
Nested Named Entity Recognition ACE 2005 seq2seq+BERT+Flair F1 84.33 #16 of 25 Archive leaderboard report
Nested Named Entity Recognition GENIA seq2seq+BERT+Flair F1 78.31 #14 of 26 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AdamAttentionAttention DropoutBERTBiLSTMDense ConnectionsDropoutELMoLSTMLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSigmoid ActivationSoftmaxTanh ActivationWeight DecayWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections