Browse State-of-the-Art › Coreference Resolution
Coreference Resolution
288 papers with code · 16 benchmarks · 45 datasets archive 2025-07-28
Coreference resolution is the task of clustering mentions in text that refer to the same underlying real world entities.
Example:
+-----------+
| |
I voted for Obama because he was most aligned with my values", she said.
| | |
+-------------------------------------------------+------------+
"I", "my", and "she" belong to the same cluster and "Obama" and "he" belong to the same cluster.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
16 leaderboard tables shown for this task, 16 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 16 until expanded.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
45 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 45 until expanded.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 880 · with a code link: 288 · where Syntology ran a sample: 43 (37 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (43 of 880 tagged: 37 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 9: papers 1 to 100 of 880, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Jun 2017 595 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified (of 946 harvested samples) · 451 pointer-only (licence)The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
-
11 Oct 2018 534 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
-
28 May 2020 67 repositories listed Syntology community repositories only · 45 ran (of which 0 constructed an object rather than computing a result; 37 with no instrument failure: 3 honoured, 2 violated, 32 with no contract checked; 8 where Syntology's instrument failed) · 20 unverified (of 65 harvested samples) · 7 pointer-only (licence)By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do.
-
23 Oct 2019 57 repositories listed Syntology 21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified (of 31 harvested samples)Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
-
15 Feb 2018 46 repositories listed Syntology 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (of 58 harvested samples) · 25 pointer-only (licence)We introduce a new type of deep contextualized word representation that models both (1) complex characteristics of word use (e. g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i. e.…
-
14 Feb 2019 21 repositories listedNatural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.
-
5 Jun 2020 14 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples) · 3 pointer-only (licence)Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks.
-
24 Jul 2019 10 repositories listedThe key steps of the dataset construction consist of (1) a carefully designed crowdsourcing procedure, followed by (2) systematic bias reduction using a novel AfLite algorithm that generalizes human-detectable word…
-
20 Oct 2022 9 repositories listed Syntology 8 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 9 unverified (of 17 harvested samples) · 2 pointer-only (licence)We find that instruction finetuning with the above aspects dramatically improves performance on a variety of model classes (PaLM, T5, U-PaLM), prompting setups (zero-shot, few-shot, CoT), and evaluation benchmarks…
-
3 Sep 2021 8 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially improves zero-shot performance on unseen tasks.
-
5 Apr 2022 7 repositories listed Syntology 32 ran (of which 16 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 1 violated, 21 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 37 harvested samples)To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model PaLM.
-
24 Jul 2019 6 repositories listed Syntology official (archive's flag): 2 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples) · 6 pointer-only (licence)We present SpanBERT, a pre-training method that is designed to better represent and predict spans of text.
-
10 Dec 2018 6 repositories listedConversational question answering (CQA) is a novel QA task that requires understanding of dialogue context.
-
16 Mar 2020 5 repositories listed Syntology community repositories only · 16 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 14 unverified (of 30 harvested samples) · 28 pointer-only (licence)We introduce Stanza, an open-source Python natural language processing toolkit supporting 66 human languages.
-
29 Aug 2018 5 repositories listedWe introduce a multi-task setup of identifying and classifying entities, relations, and coreference clusters in scientific articles.
-
15 Apr 2018 5 repositories listed Syntology official (archive's flag): 5 ran · 17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 23 harvested samples) · 3 pointer-only (licence)We introduce a fully differentiable approximation to higher-order inference for coreference resolution.
-
3 Apr 2023 4 repositories listedHow do large language models (LLMs) develop and evolve over the course of training?
-
11 Oct 2018 4 repositories listedCoreference resolution is an important task for natural language understanding, and the resolution of ambiguous pronouns a longstanding challenge.
-
25 Apr 2018 4 repositories listedWe present an empirical study of gender bias in coreference resolution systems.
-
18 Apr 2018 4 repositories listedWe introduce a new benchmark, WinoBias, for coreference resolution focused on gender bias.
-
21 Jul 2017 4 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)We introduce the first end-to-end coreference resolution model and show that it significantly outperforms all previous work without using a syntactic parser or hand-engineered mention detector.
-
28 Dec 2022 3 repositories listed Syntology official (archive's flag): 1 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 15 harvested samples)First, we use synthetic language modeling tasks to understand the gap between SSMs and attention.
-
5 Oct 2022 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Prompting is a brittle process wherein small modifications to the prompt can cause large variations in the model predictions, and therefore significant effort is dedicated towards designing a painstakingly "perfect…
-
17 Feb 2022 3 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)But advancing the state-of-the-art across a broad set of natural language tasks has been hindered by training instabilities and uncertain quality during fine-tuning.
-
30 Jun 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Experiments with pre-trained models such as BERT are often based on a single checkpoint.
-
6 Oct 2020 3 repositories listedLong document coreference resolution remains a challenging task due to the large memory and runtime requirements of current models.
-
3 Dec 2019 3 repositories listedWe present in this work a new dataset of coreference annotations for works of literature in English, covering 29, 103 mentions in 210, 532 tokens from 100 works of fiction.
-
7 Oct 2019 3 repositories listedOur analysis shows the properties of chains that are crucial for high performance: in particular, modeling extraction sequentially is important, as is dealing with each candidate sentence in a context-aware way.
-
27 Jul 2019 3 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)An HNN consists of two component models, a masked language model and a semantic similarity model, which share a BERT-based contextual encoder but use different model-specific input and output layers.
-
5 May 2024 2 repositories listedOur contributions are: 1) Created Supervised Fine-Tuning (SFT) training data in alpaca format, along with a set of Low-Rank Adaptation (LoRA) weights, and 2) Developed a method for acquiring high-quality data leveraging…
-
23 May 2023 2 repositories listed
-
7 Feb 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
13 Jul 2022 2 repositories listed Syntology official (archive's flag): 5 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
25 May 2022 2 repositories listed Syntology official (archive's flag): 6 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
10 May 2022 2 repositories listed Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 16 harvested samples)
-
3 Apr 2022 2 repositories listed
-
25 Feb 2022 2 repositories listed
-
20 Sep 2021 2 repositories listed
-
18 Apr 2021 2 repositories listed
-
17 Apr 2021 2 repositories listed
-
11 Apr 2021 2 repositories listed
-
14 Jan 2021 2 repositories listed
-
2 Jan 2021 2 repositories listed
-
6 Oct 2020 2 repositories listed
-
26 Sep 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 4 pointer-only (licence)
-
23 Sep 2020 2 repositories listed
-
30 Apr 2020 2 repositories listed
-
24 Aug 2019 2 repositories listed
-
31 May 2019 2 repositories listed
-
15 May 2019 2 repositories listed
-
1 Aug 2018 2 repositories listed
-
2 Aug 2017 2 repositories listed
-
16 May 2025 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
18 Apr 2025 1 repository listed
-
14 Apr 2025 1 repository listed
-
18 Feb 2025 1 repository listed
-
16 Dec 2024 1 repository listed
-
12 Nov 2024 1 repository listed
-
22 Oct 2024 1 repository listed
-
21 Oct 2024 1 repository listed
-
12 Oct 2024 1 repository listed
-
4 Oct 2024 1 repository listed
-
3 Oct 2024 1 repository listed
-
22 Sep 2024 1 repository listed
-
9 Sep 2024 1 repository listed
-
29 Aug 2024 1 repository listed
-
31 Jul 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
9 Jul 2024 1 repository listed
-
23 Jun 2024 1 repository listed
-
23 Jun 2024 1 repository listed
-
20 Jun 2024 1 repository listed
-
20 Jun 2024 1 repository listed
-
10 Jun 2024 1 repository listed
-
4 Jun 2024 1 repository listed
-
30 Apr 2024 1 repository listed
-
25 Apr 2024 1 repository listed
-
19 Apr 2024 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
13 Apr 2024 1 repository listed
-
Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation4 Apr 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
2 Apr 2024 1 repository listed
-
1 Apr 2024 1 repository listed
-
31 Mar 2024 1 repository listed
-
25 Mar 2024 1 repository listed
-
25 Mar 2024 1 repository listed
-
21 Feb 2024 1 repository listed
-
1 Dec 2023 1 repository listed
-
24 Nov 2023 1 repository listed
-
19 Nov 2023 1 repository listed
-
26 Oct 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 3 pointer-only (licence)
-
9 Oct 2023 1 repository listed
-
20 Sep 2023 1 repository listed
-
10 Sep 2023 1 repository listed
-
14 Jul 2023 1 repository listed
-
1 Jul 2023 1 repository listed
-
6 Jun 2023 1 repository listed
Syntology lines on 30 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections