</> Code with Papers by Syntology

Datasets › SciERC

SciERC

Introduced by Yi Luan et al. in Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction1 Jan 2018 archive 2025-07-28

SciERC dataset is a collection of 500 scientific abstract annotated with scientific entities, their relations, and coreference clusters. The abstracts are taken from 12 AI conference/workshop proceedings in four AI communities, from the Semantic Scholar Corpus. SciERC extends previous datasets in scientific articles SemEval 2017 Task 10 and SemEval 2018 Task 7 by extending entity types, relation types, relation coverage, and adding cross-sentence relations using coreference links.

Source: http://nlp.cs.washington.edu/sciIE/ Image Source: http://nlp.cs.washington.edu/sciIE/

HomepageBenchmarksPapers JSON

Benchmarks archive 2025-07-28

All 7 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Joint Entity and Relation Extraction SciERC PL-Marker Relation F1 53.2 Packed Levitated Marker for Entity and Relation Extraction tomaarsen/spanmarkerner +1 11 Compare
Named Entity Recognition (NER) SciERC SciDeBERTa v2 F1 72.4 SciDeBERTa: Learning DeBERTa for Science Technology... Eunhui-Kim/SciDeBERTa-Fine-Tuning 7 Compare
Relation Extraction SciERC SciBERT (SciVocab) F1 74.64 SciBERT: A Pretrained Language Model for Scientific Text allenai/scibert +5 3 Compare
Continual Pretraining SciERC DAS F1 (macro) 0.7093 Continual Pre-training of Language Models zixuanke/pycontinual +1 1 Compare
Few-Shot Relation Classification SciERC DL-MNAV+SIE+SBN F1 (1-Doc) 2.85 Few-Shot Document-Level Relation Extraction nicpopovic/fredo 1 Compare
Relation Extraction sciERC-sent RELA F1 90.3 Sequence Generation with Label Augmentation for Relation... pkuserc/rela 1 Compare
UIE SciERC KnowCoder-7b-IE F1 score 40.0 KnowCoder: Coding Structured Knowledge into LLMs for... ICT-GoKnow/KnowCoder 1 Compare

Papers archive 2025-07-28

17 shown of 17 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 134. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction 1 1 12 Mar 2024 not harvested
Continual Pre-training of Language Models 2 1 7 Feb 2023 not harvested
Sequence Generation with Label Augmentation for Relation Extraction 1 1 29 Dec 2022 not harvested
A Multi-Gate Encoder for Joint Entity and Relation Extraction 0 1 1 Oct 2022 not harvested
SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction Tasks 1 1 8 Jun 2022 not harvested
Few-Shot Document-Level Relation Extraction 1 1 4 May 2022 not harvested
Joint Entity and Relation Extraction from Scientific Documents: Role of Linguistic Information and Entity Types 1 1 30 Sep 2021 not harvested
Packed Levitated Marker for Entity and Relation Extraction 2 1 13 Sep 2021 ran 3 of 9 samples (6 unverified; 1 pointer-only for licence)
A Partition Filter Network for Joint Entity and Relation Extraction 1 2 27 Aug 2021 ran 5 of 7 samples (2 unverified)
A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extraction 1 1 25 Jan 2021 not harvested
A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition 1 1 2 Jan 2021 not harvested
A Frustratingly Easy Approach for Entity and Relation Extraction 2 2 24 Oct 2020 ran 3 of 4 samples (1 unverified; 1 pointer-only for licence)
Span-based Joint Entity and Relation Extraction with Transformer Pre-training 3 3 17 Sep 2019 not harvested
Entity, Relation, and Event Extraction with Contextualized Span Representations 4 1 8 Sep 2019 ran 0 of 7 samples (7 unverified)
A General Framework for Information Extraction using Dynamic Span Graphs 3 1 5 Apr 2019 not harvested
SciBERT: A Pretrained Language Model for Scientific Text 6 4 26 Mar 2019 not harvested
Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction 5 2 29 Aug 2018 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

Named Entity Recognition (NER)Relation ExtractionUIEJoint Entity and Relation ExtractionNamed Entity RecognitionFew-Shot Relation ClassificationContinual Pretraining

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Texts

Languages archive 2025-07-28

English

Variants archive 2025-07-28

  • SciERC
  • sciERC-sent

2 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections