</> Code with Papers by Syntology

Datasets › OntoNotes 5.0

OntoNotes 5.0

Introduced by Sameer Pradhan et al. in Towards Robust Linguistic Analysis using OntoNotes1 Aug 2013 archive 2025-07-28

OntoNotes 5.0 is a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, usenet newsgroups, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference).

OntoNotes Release 5.0 contains the content of earlier releases - and adds source data from and/or additional annotations for, newswire, broadcast news, broadcast conversation, telephone conversation and web data in English and Chinese and newswire data in Arabic.

Source: https://catalog.ldc.upenn.edu/LDC2013T19

HomepageBenchmarksPapers JSON

Benchmarks archive 2025-07-28

All 12 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Named Entity Recognition (NER) Ontonotes v5 (English) BERT-MRC+DSC F1 92.07 Dice Loss for Data-imbalanced NLP Tasks ShannonAI/dice_loss_for_NLP +3 28 Compare
Coreference Resolution OntoNotes Maverick_mes F1 83.6 Maverick: Efficient and Accurate Coreference Resolution... sapienzanlp/maverick-coref 26 Compare
Semantic Role Labeling OntoNotes HeSyFu F1 88.59 Better Combine Them Together! Integrating Syntactic... scofield7419/hesyfu 17 Compare
Entity Typing Ontonotes v5 (English) MLMET F1 49.1 Ultra-Fine Entity Typing with Weak Supervision from a... HKUST-KnowComp/MLMET 4 Compare
Named Entity Recognition (NER) OntoNotes DeepStruct multi-task w/ finetune F1 87.8 DeepStruct: Pretraining of Language Models for Structure... cgraywang/deepstruct 3 Compare
Named Entity Recognition (NER) OntoNotes 5.0 HGN Average F1 90.92 Hero-Gang Neural Model For Named Entity Recognition jinpeng01/hgn 2 Compare
Chinese Named Entity Recognition OntoNotes 5.0 DGLSTM-CRF F1 79.92 Dependency-Guided LSTM-CRF for Named Entity Recognition allanj/ner_with_dependency 1 Compare
Entity Typing OntoNotes LITE Macro F1 86.6 Ultra-fine Entity Typing with Indirect Supervision from... luka-group/lite 1 Compare
FG-1-PG-1 OntoNotes 5.0 CFNER F1 (macro) 0.4222 Distilling Causal Effect from Miscellaneous Other-Class... zzz47zzz/CFNER 1 Compare
Generalized Zero-Shot Learning OntoNotes ZSL-KG F1 45.21 Zero-Shot Learning with Common Sense Knowledge Graphs BatsResearch/zsl-kg +2 1 Compare
UIE OntoNotes 5.0 KnowCoder-7b-IE F1 score 88.2 KnowCoder: Coding Structured Knowledge into LLMs for... ICT-GoKnow/KnowCoder 1 Compare
coreference-resolution OntoNotes no rows — — 0 Compare

Papers archive 2025-07-28

30 shown of 66 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 254. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends 1 1 31 Jul 2024 ran 5 of 11 samples (6 unverified; 11 pointer-only for licence)
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction 1 1 12 Mar 2024 not harvested
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data 1 1 23 Feb 2024 not harvested
CAW-coref: Conjunction-Aware Word-level Coreference Resolution 1 1 9 Oct 2023 not harvested
Label Supervised LLaMA Finetuning 2 1 2 Oct 2023 not harvested
Augmenting Transformers with Recursively Composed Multi-grained Representations 1 1 28 Sep 2023 ran 3 of 3 samples (0 unverified)
DiffusionNER: Boundary Diffusion for Named Entity Recognition 3 1 22 May 2023 not harvested
Coreference Resolution through a seq2seq Transition-Based System 1 1 22 Nov 2022 not harvested
Autoregressive Structured Prediction with Language Models 1 1 26 Oct 2022 not harvested
Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition 1 1 8 Oct 2022 not harvested
Efficient and Interpretable Neural Models for Entity Tracking 0 1 30 Aug 2022 not harvested
Syntax-driven Approach for Semantic Role Labeling 1 1 1 Jun 2022 not harvested
LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution 2 1 25 May 2022 ran 1 of 11 samples (10 unverified)
DeepStruct: Pretraining of Language Models for Structure Prediction 1 3 21 May 2022 ran 7 of 13 samples (6 unverified)
Hero-Gang Neural Model For Named Entity Recognition 1 2 15 May 2022 not harvested
Boundary Smoothing for Named Entity Recognition 1 1 26 Apr 2022 not harvested
Graph Refinement for Coreference Resolution 1 2 30 Mar 2022 not harvested
Parallel Instance Query Network for Named Entity Recognition 1 1 20 Mar 2022 not harvested
Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference 1 1 12 Feb 2022 not harvested
Unified Named Entity Recognition as Word-Word Relation Classification 1 1 19 Dec 2021 not harvested
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments 1 3 13 Oct 2021 ran 0 of 1 samples (1 unverified)
On Generalization in Coreference Resolution 2 3 20 Sep 2021 not harvested
An MRC Framework for Semantic Role Labeling 1 1 14 Sep 2021 not harvested
Packed Levitated Marker for Entity and Relation Extraction 2 1 13 Sep 2021 ran 3 of 9 samples (6 unverified; 1 pointer-only for licence)
Word-Level Coreference Resolution 1 1 9 Sep 2021 not harvested
Better Combine Them Together! Integrating Syntactic Constituency and Dependency Representations for Semantic Role Labeling 1 1 1 Aug 2021 not harvested
Constraining Linear-chain CRFs to Regular Languages 1 2 14 Jun 2021 not harvested
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model 1 1 8 Jun 2021 not harvested
A Unified Generative Framework for Various NER Subtasks 1 1 2 Jun 2021 not harvested
Better Feature Integration for Named Entity Recognition 1 2 12 Apr 2021 not harvested

The full list of 66 is in the JSON twin.

Dataset loaders archive 2025-07-28

huggingface.co/datasets/ontonotes/conll2012_ontonotesv5huggingface/datasetstfpytorchjax
huggingface.co/datasets/conll2012_ontonotesv5huggingface/datasetstfpytorchjax
docs.allennlp.org/models/main/models/tagging/dataset_readers/ontonotes_ner/allenai/allennlp-modelspytorch

3 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

Named Entity Recognition (NER)UIECoreference ResolutionGeneralized Zero-Shot LearningSemantic Role LabelingNamed Entity RecognitionWeakly-Supervised Named Entity RecognitionEntity TypingChinese Named Entity RecognitionFG-1-PG-1coreference-resolution

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Texts

Languages archive 2025-07-28

EnglishChineseArabic

Variants archive 2025-07-28

  • Ontonotes v5 (English)
  • OntoNotes
  • OntoNotes 5.0

3 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections