Datasets › ACE 2004

ACE 2004 (ACE 2004 Multilingual Training Corpus)

Introduced in Ace 2004 multilingual training corpus archive 2025-07-28

ACE 2004 Multilingual Training Corpus contains the complete set of English, Arabic and Chinese training data for the 2004 Automatic Content Extraction (ACE) technology evaluation. The corpus consists of data of various types annotated for entities and relations and was created by Linguistic Data Consortium with support from the ACE Program, with additional assistance from the DARPA TIDES (Translingual Information Detection, Extraction and Summarization) Program. The objective of the ACE program is to develop automatic content extraction technology to support automatic processing of human language in text form. In September 2004, sites were evaluated on system performance in six areas: Entity Detection and Recognition (EDR), Entity Mention Detection (EMD), EDR Co-reference, Relation Detection and Recognition (RDR), Relation Mention Detection (RMD), and RDR given reference entities. All tasks were evaluated in three languages: English, Chinese and Arabic.

Source: https://catalog.ldc.upenn.edu/LDC2005T09

Benchmarks archive 2025-07-28

All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

papers with a benchmark row: 40 · with a code link: 37 · where Syntology ran a sample: 7 (7 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (7 of 40 with a benchmark row: 7 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 40 of 40 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 51. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
To be Continuous, or to be Discrete, Those are Bits of Questions 1 1 12 Jun 2024 not harvested
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction 1 1 12 Mar 2024 not harvested
PromptNER: Prompt Locating and Typing for Named Entity Recognition 1 2 26 May 2023 not harvested
DiffusionNER: Boundary Diffusion for Named Entity Recognition 3 1 22 May 2023 not harvested
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning 1 1 30 Aug 2022 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition 1 1 9 Aug 2022 not harvested
Improving Entity Disambiguation by Reasoning over a Knowledge Base 3 1 8 Jul 2022 not harvested
ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking 3 1 8 Jul 2022 not harvested
Boundary Smoothing for Named Entity Recognition 1 1 26 Apr 2022 not harvested
Parallel Instance Query Network for Named Entity Recognition 1 2 20 Mar 2022 not harvested
Unified Named Entity Recognition as Word-Word Relation Classification 1 1 19 Dec 2021 not harvested
Named Entity Recognition for Entity Linking: What Works and What’s Next 1 1 1 Nov 2021 not harvested
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition 1 2 14 Oct 2021 not harvested
Packed Levitated Marker for Entity and Relation Extraction 2 1 13 Sep 2021 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (3 pointer-only for licence)
A Partition Filter Network for Joint Entity and Relation Extraction 1 1 27 Aug 2021 official (archive's flag): 5 ran · 5 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
Nested Named Entity Recognition via Explicitly Excluding the Influence of the Best Path 1 1 1 Aug 2021 not harvested
BoningKnife: Joint Entity Mention Detection and Typing for Nested NER via prior Boundary Knowledge 0 3 20 Jul 2021 not harvested
A Unified Generative Framework for Various NER Subtasks 1 1 2 Jun 2021 not harvested
A Sequence-to-Set Network for Nested Named Entity Recognition 1 1 19 May 2021 official (archive's flag): 5 ran · 5 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (5 pointer-only for licence)
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition 1 1 14 May 2021 not harvested
Nested Named Entity Recognition with Partially-Observed TreeCRFs 1 1 15 Dec 2020 not harvested
A Frustratingly Easy Approach for Entity and Relation Extraction 2 2 24 Oct 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders 2 1 8 Oct 2020 official: harvested, nothing ran · 0 ran · 3 unverified (3 pointer-only for licence)
Autoregressive Entity Retrieval 2 1 2 Oct 2020 not harvested
Named Entity Recognition as Dependency Parsing 1 1 14 May 2020 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (2 pointer-only for licence)
A Unified MRC Framework for Named Entity Recognition 8 1 25 Oct 2019 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence)
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding 3 5 5 Sep 2019 not harvested
Global Entity Disambiguation with BERT 1 1 1 Sep 2019 not harvested
Neural Architectures for Nested NER through Linearization 1 3 19 Aug 2019 not harvested
Multi-Grained Named Entity Recognition 1 3 20 Jun 2019 not harvested
Entity-Relation Extraction as Multi-Turn Question Answering 1 1 14 May 2019 not harvested
A General Framework for Information Extraction using Dynamic Span Graphs 3 1 5 Apr 2019 not harvested
A Neural Transition-based Model for Nested Mention Recognition 1 3 3 Oct 2018 not harvested
Neural Segmental Hypergraphs for Overlapping Mention Recognition 1 3 3 Oct 2018 not harvested
Adversarial training for multi-context joint entity and relation extraction 1 1 21 Aug 2018 not harvested
Joint entity recognition and relation extraction as a multi-head selection problem 6 1 20 Apr 2018 not harvested
Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees 0 1 1 Jul 2017 not harvested
Deep Joint Entity Disambiguation with Local Neural Attention 3 1 17 Apr 2017 not harvested
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures 2 1 5 Jan 2016 not harvested
Incremental Joint Extraction of Entity Mentions and Relations 0 1 1 Jun 2014 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Custom

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • ACE 2004
  • ACE2004

2 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections