Browse State-of-the-Art › Named Entity Recognition (NER)
Named Entity Recognition (NER)
955 papers with code · 76 benchmarks · 130 datasets archive 2025-07-28
Named Entity Recognition (NER) is a task of Natural Language Processing (NLP) that involves identifying and classifying named entities in a text into predefined categories such as person names, organizations, locations, and others. The goal of NER is to extract structured information from unstructured text data and represent it in a machine-readable format. Approaches typically use BIO notation, which differentiates the beginning (B) and the inside (I) of entities. O is used for non-entity tokens.
Example:
| Mark | Watney | visited | Mars |
|---|---|---|---|
| B-PER | I-PER | O | B-LOC |
( Image credit: Zalando )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
76 leaderboard tables shown for this task, 76 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 76 until expanded.
Syntology 4 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CoNLL 2003 (English) (2 judged, 0 placed), BC5CDR (1 judged, 0 placed), GENIA (1 judged, 0 placed), BC2GM (1 judged, 0 placed), SciERC (1 judged, 0 placed), BC4CHEMD (1 judged, 0 placed), AnatEM (1 judged, 0 placed), BioRED (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
130 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 130 until expanded.
Subtasks archive 2025-07-28
13 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 2,874 · with a code link: 955 · where Syntology ran a sample: 119 (97 with a run with no instrument failure, 22 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (119 of 2,874 tagged: 97 with a run with no instrument failure, 22 where every run was a failure of Syntology's instrument)
Page 1 of 29: papers 1 to 100 of 2,874, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 Oct 2018 534 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
-
15 Feb 2018 46 repositories listed Syntology 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (of 58 harvested samples) · 25 pointer-only (licence)We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e. g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i. e.…
-
4 Mar 2016 43 repositories listed Syntology community repositories only · 29 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 1 violated, 19 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified (of 36 harvested samples) · 6 pointer-only (licence)State-of-the-art named entity recognition systems rely heavily on hand-crafted features and domain-specific knowledge in order to learn effectively from the small, supervised training corpora that are available.
-
4 Mar 2016 25 repositories listed Syntology 24 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 0 violated, 20 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 24 harvested samples) · 3 pointer-only (licence)State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing.
-
9 Aug 2015 25 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)It can also use sentence level tag information thanks to a CRF layer.
-
19 Apr 2019 19 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
-
25 Jan 2019 19 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 15 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified (of 25 harvested samples) · 3 pointer-only (licence)Biomedical text mining is becoming increasingly important as the number of biomedical documents rapidly grows.
-
5 Jun 2020 14 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples) · 3 pointer-only (licence)Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks.
-
26 Nov 2015 14 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 4 pointer-only (licence)Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance.
-
31 Aug 2019 10 repositories listedThe pre-trained language models have achieved great successes in various natural language understanding (NLU) tasks due to its capacity to capture the deep contextualized information in text by pre-training on…
-
2 Oct 2020 9 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 10 harvested samples)In this paper, we propose new pretrained contextualized representations of words and entities based on the bidirectional transformer.
-
10 Nov 2019 8 repositories listedWe show that the use of web crawled data is preferable to the use of Wikipedia data.
-
25 Oct 2019 8 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 2 pointer-only (licence)Instead of treating the task of NER as a sequence labeling problem, we propose to formulate it as a machine reading comprehension (MRC) task.
-
16 May 2021 7 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)In this paper, we present Few-NERD, a large-scale human-annotated few-shot NER dataset with a hierarchy of 8 coarse-grained and 66 fine-grained entity types.
-
10 Nov 2019 6 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)The Bidirectional long short-term memory networks (BiLSTM) have been widely used as an encoder in models solving the named entity recognition (NER) task.
-
26 Mar 2019 6 repositories listedObtaining large-scale annotated data for NLP tasks in the scientific domain is challenging and expensive.
-
20 Jun 2018 6 repositories listed Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples) · 4 pointer-only (licence)Though designed for decaNLP, MQAN also achieves state of the art results on the WikiSQL semantic parsing task in the single-task setting.
-
21 Jul 2017 6 repositories listedSelecting optimal parameters for a neural network architecture can often make the difference between mediocre and state-of-the-art performance.
-
8 Dec 2020 5 repositories listedCross-domain named entity recognition (NER) models are able to cope with the scarcity issue of NER samples in target domains.
-
29 Jul 2020 5 repositories listedWe introduce biomedical and clinical English model packages for the Stanza Python NLP library.
-
16 Mar 2020 5 repositories listed Syntology community repositories only · 16 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 14 unverified (of 30 harvested samples) · 28 pointer-only (licence)We introduce Stanza, an open-source Python natural language processing toolkit supporting 66 human languages.
-
29 Aug 2018 5 repositories listedWe introduce a multi-task setup of identifying and classifying entities, relations, and coreference clusters in scientific articles.
-
31 Jul 2017 5 repositories listedIn this paper we show that reporting a single performance score is insufficient to compare non-deterministic approaches.
-
18 Apr 2022 4 repositories listedIn this paper, we propose LayoutLMv3 to pre-train multimodal Transformers for Document AI with unified text and image masking.
-
20 May 2021 4 repositories listedWe introduce Korean Language Understanding Evaluation (KLUE) benchmark.
-
24 Oct 2020 4 repositories listedWe re-evaluate the standard practice of sharing weights between input and output embeddings in state-of-the-art pre-trained language models.
-
30 Jul 2020 4 repositories listedNamed Entity Recognition (NER) is a fundamental NLP task, commonly formulated as classification over a sequence of tokens.
-
28 Feb 2020 4 repositories listedRecently, with the surge of transformers based models, language-specific BERT based models have proven to be very efficient at language understanding, provided they are pre-trained on a very large corpus.
-
7 Nov 2019 4 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Many NLP tasks such as tagging and machine reading comprehension are faced with the severe data imbalance issue: negative examples significantly outnumber positive examples, and the huge number of background examples…
-
8 Sep 2019 4 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction.
-
13 Jun 2019 4 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
29 Mar 2019 4 repositories listed
-
13 Nov 2018 4 repositories listed
-
18 Mar 2017 4 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
7 Feb 2017 4 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
22 Aug 2016 4 repositories listed Syntology official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)
-
1 Oct 2014 4 repositories listed
-
12 Jun 2003 4 repositories listed
-
27 Nov 2024 3 repositories listed
-
22 May 2023 3 repositories listed
-
22 Feb 2023 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
25 Jan 2023 3 repositories listed
-
8 Nov 2022 3 repositories listed
-
30 Jun 2021 3 repositories listed
-
8 May 2021 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
26 May 2020 3 repositories listed
-
20 May 2020 3 repositories listed
-
30 Apr 2020 3 repositories listed
-
19 Mar 2020 3 repositories listed
-
16 Mar 2020 3 repositories listed
-
13 Jan 2020 3 repositories listed
-
10 Nov 2019 3 repositories listed
-
7 Oct 2019 3 repositories listed
-
17 Sep 2019 3 repositories listed
-
17 Sep 2019 3 repositories listed
-
5 Sep 2019 3 repositories listed
-
29 Aug 2019 3 repositories listed
-
29 Jul 2019 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
5 Apr 2019 3 repositories listed
-
4 Apr 2019 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
22 Mar 2019 3 repositories listed
-
23 Jan 2019 3 repositories listed
-
14 Jun 2018 3 repositories listed Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
13 Sep 2017 3 repositories listed
-
24 Apr 2017 3 repositories listed
-
1 Apr 2025 2 repositories listed
-
12 Sep 2024 2 repositories listed
-
20 Apr 2024 2 repositories listed
-
18 Mar 2024 2 repositories listed
-
26 Feb 2024 2 repositories listed
-
15 Nov 2023 2 repositories listed
-
14 Nov 2023 2 repositories listed
-
17 Oct 2023 2 repositories listed
-
13 Oct 2023 2 repositories listed
-
2 Oct 2023 2 repositories listed
-
24 Aug 2023 2 repositories listed
-
7 Aug 2023 2 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 2 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 3 pointer-only (licence)
-
28 Jun 2023 2 repositories listed
-
8 Jun 2023 2 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
26 Apr 2023 2 repositories listed
-
21 Apr 2023 2 repositories listed
-
13 Feb 2023 2 repositories listed
-
25 Jan 2023 2 repositories listed
-
13 Dec 2022 2 repositories listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples)
-
20 Nov 2022 2 repositories listed
-
18 Nov 2022 2 repositories listed
-
27 Oct 2022 2 repositories listed
-
1 Oct 2022 2 repositories listed
-
29 May 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
11 Apr 2022 2 repositories listed
-
9 Apr 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
17 Jan 2022 2 repositories listed
-
18 Oct 2021 2 repositories listed Syntology community repositories only · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 5 harvested samples)
-
17 Sep 2021 2 repositories listed
-
17 Sep 2021 2 repositories listed
-
14 Sep 2021 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
13 Sep 2021 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
15 Jun 2021 2 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 2 pointer-only (licence)
-
30 May 2021 2 repositories listed
Syntology lines on 36 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections