Papers › Nested Named Entity Recognition via Second-best Sequence Learning and Decoding

Nested Named Entity Recognition via Second-best Sequence Learning and Decoding

5 Sep 2019arXiv:1909.02250archive 2025-07-28

Takashi Shibuya, Eduard Hovy

When an entity name contains other names within it, the identification of all combinations of names can become difficult and expensive. We propose a new method to recognize not only outermost named entities but also inner nested ones. We design an objective function for training a neural model that treats the tag sequence for nested entities as the second best path within the span of their parent entity. In addition, we provide the decoding method for inference that extracts entities iteratively from outermost ones to inner ones in an outside-to-inside way. Our method has no additional hyperparameters to the conditional random field based model widely used for flat named entity recognition tasks. Experiments demonstrate that our method performs better than or at least as well as existing methods capable of handling nested entities, achieving the F1-scores of 85.82%, 84.34%, and 77.36% on ACE-2004, ACE-2005, and GENIA datasets, respectively.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

yahshibu/nested-ner-tacl2020 officialmentioned in papermentioned on GitHubpytorchGPL-3.0 report
yahshibu/nested-ner-tacl2020-flair officialmentioned in papermentioned on GitHubpytorchGPL-3.0 report
yahshibu/nested-ner-tacl2020-transformers officialmentioned in papermentioned on GitHubpytorchGPL-3.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Named Entity RecognitionNamed Entity Recognition (NER)Nested Mention RecognitionNested Named Entity RecognitionTAGnamed-entity-recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) ACE 2004 Second-best learning and decoding F1 85.82 #5 of 9 Archive leaderboard report
Named Entity Recognition (NER) ACE 2004 Second-best learning and decoding Multi-Task Supervision n #5 of 9 Archive leaderboard report
Named Entity Recognition (NER) ACE 2005 Second-best learning and decoding F1 84.34 #12 of 20 Archive leaderboard report
Named Entity Recognition (NER) GENIA Second-best learning and decoding + BERT + Flair F1 77.36 #6 of 14 Archive leaderboard report
Named Entity Recognition (NER) GENIA Second-best learning and decoding F1 77.19 #7 of 14 Archive leaderboard report
Nested Mention Recognition ACE 2004 Second-best learning and decoding F1 85.82 #3 of 7 Archive leaderboard report
Nested Mention Recognition ACE 2005 Second-best learning and decoding F1 84.34 #2 of 10 Archive leaderboard report
Nested Named Entity Recognition ACE 2004 Second-best learning and decoding + BERT + Flair F1 85.82 #18 of 24 Archive leaderboard report
Nested Named Entity Recognition ACE 2004 Second-best learning and decoding + BERT F1 84.97 #19 of 24 Archive leaderboard report
Nested Named Entity Recognition ACE 2004 Second-best learning and decoding F1 77.44 #22 of 24 Archive leaderboard report
Nested Named Entity Recognition ACE 2005 Second-best learning and decoding + BERT + Flair F1 84.34 #15 of 25 Archive leaderboard report
Nested Named Entity Recognition ACE 2005 Second-best learning and decoding + BERT F1 83.99 #17 of 25 Archive leaderboard report
Nested Named Entity Recognition ACE 2005 Second-best learning and decoding F1 76.83 #20 of 25 Archive leaderboard report
Nested Named Entity Recognition GENIA Second-best learning and decoding + BERT + Flair F1 77.36 #18 of 26 Archive leaderboard report
Nested Named Entity Recognition GENIA Second-best learning and decoding F1 77.19 #19 of 26 Archive leaderboard report
Nested Named Entity Recognition GENIA Second-best learning and decoding + BERT F1 77.05 #20 of 26 Archive leaderboard report
Nested Named Entity Recognition NNE Second-best learning and decoding Micro F1 93.19 #4 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections