Papers › WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols

WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols

27 Oct 2020EMNLP (WNUT) 2020 11arXiv:2010.14576archive 2025-07-28

Jeniya Tabassum, Sydney Lee, Wei Xu, Alan Ritter

This paper presents the results of the wet lab information extraction task at WNUT 2020. This task consisted of two sub tasks: (1) a Named Entity Recognition (NER) task with 13 participants and (2) a Relation Extraction (RE) task with 2 participants. We outline the task, data annotation process, corpus statistics, and provide a high-level overview of the participating systems for each sub task.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

jeniyat/WNUT_2020_NER officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

NERNamed Entity RecognitionNamed Entity Recognition (NER)Relation Extractionnamed-entity-recognition

1 archive task tag without a task page not shown.

Datasets

Introduced by this paper, per the archive.

WNUT 2020

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) WNUT 2020 Baseline F1 65.73 #3 of 3 Archive leaderboard report
Named Entity Recognition (NER) WNUT 2020 Baseline Precision 70.06 #3 of 3 Archive leaderboard report
Named Entity Recognition (NER) WNUT 2020 Baseline Recall 61.91 #3 of 3 Archive leaderboard report
Relation Extraction WNUT 2020 Baseline F1 72.5 #1 of 1 Archive leaderboard report
Relation Extraction WNUT 2020 Baseline Precision 80.1 #1 of 1 Archive leaderboard report
Relation Extraction WNUT 2020 Baseline Recall 66.21 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections