</> Code with Papers by Syntology

Datasets › WNUT 2017

WNUT 2017 (WNUT 2017 Emerging and Rare entity recognition)

Introduced by Leon Derczynski et al. in Results of the WNUT2017 Shared Task on Novel and Emerging Entity Recognition1 Sep 2017 archive 2025-07-28

This shared task focuses on identifying unusual, previously-unseen entities in the context of emerging discussions. Named entities form the basis of many modern approaches to other tasks (like event clustering and summarisation), but recall on them is a real problem in noisy text - even among annotators. This drop tends to be due to novel entities and surface forms. Take for example the tweet “so.. kktny in 30 mins?” - even human experts find entity kktny hard to detect and resolve. This task will evaluate the ability to detect and classify novel, emerging, singleton named entities in noisy text.

The goal of this task is to provide a definition of emerging and of rare entities, and based on that, also datasets for detecting these entities.

HomepageBenchmarksPapers JSON

Benchmarks archive 2025-07-28

All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Named Entity Recognition (NER) WNUT 2017 CL-KL F1 60.45 Improving Named Entity Recognition by External Context... modelscope/adaseq +2 23 Compare
UIE WNUT 2017 KnowCoder-7b-IE F1 score 66.4 KnowCoder: Coding Structured Knowledge into LLMs for... ICT-GoKnow/KnowCoder 1 Compare

Papers archive 2025-07-28

21 shown of 21 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 127. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization 1 1 10 Sep 2024 not harvested
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction 1 1 12 Mar 2024 not harvested
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction 1 1 5 Oct 2023 ran 18 of 25 samples (7 unverified)
Supplementary Features of BiLSTM for Enhanced Sequence Labeling 1 1 31 May 2023 not harvested
T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition 1 1 9 Sep 2022 ran 3 of 3 samples (0 unverified; 3 pointer-only for licence)
Adversarial Self-Attention for Language Understanding 1 2 25 Jun 2022 not harvested
Hero-Gang Neural Model For Named Entity Recognition 1 1 15 May 2022 not harvested
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective 2 1 9 Apr 2022 ran 0 of 2 samples (2 unverified)
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning 3 2 8 May 2021 ran 0 of 4 samples (4 unverified)
InferNER: an attentive model leveraging the sentence-level information for Named Entity Recognition in Microblogs 0 1 18 Apr 2021 not harvested
Regularization for Long Named Entity Recognition 1 2 15 Apr 2021 not harvested
Named Entity Recognition for Social Media Texts with Semantic Augmentation 1 1 29 Oct 2020 not harvested
Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information 1 1 29 Oct 2020 not harvested
BERTweet: A pre-trained language model for English Tweets 3 1 20 May 2020 not harvested
Robust Named Entity Recognition with Truecasing Pretraining 0 1 15 Dec 2019 not harvested
Similarity Based Auxiliary Classifier for Named Entity Recognition 1 1 1 Nov 2019 not harvested
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations 1 1 3 Sep 2019 ran 4 of 4 samples (0 unverified)
Why Attention? Analyze BiLSTM Deficiency and Its Remedies in the Case of NER 3 1 29 Aug 2019 not harvested
Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media 0 1 10 Jun 2019 not harvested
A Multi-task Approach for Named Entity Recognition in Social Media Data 1 1 10 Jun 2019 not harvested
Transfer Learning and Sentence Level Features for Named Entity Recognition on Tweets 0 1 1 Sep 2017 not harvested

Dataset loaders archive 2025-07-28

huggingface.co/datasets/leondz/wnut_17huggingface/datasetstfpytorchjax
huggingface.co/datasets/Jnanesh12/Slanghuggingface/datasetstfpytorchjax
huggingface.co/datasets/Kriyans/nerhuggingface/datasetstfpytorchjax
huggingface.co/datasets/Kriyans/indian_nameshuggingface/datasetstfpytorchjax
huggingface.co/datasets/wnut_17huggingface/datasetstfpytorchjax

5 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

Named Entity Recognition (NER)UIEFew-shot NER

License archive 2025-07-28

CC-BY 4.0

Modalities archive 2025-07-28

Texts

Languages archive 2025-07-28

English

Variants archive 2025-07-28

  • Long-tail emerging entities
  • WNUT 2017
  • wnut_17

3 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections