Papers › Learning from Noisy Labels for Entity-Centric Information Extraction

Learning from Noisy Labels for Entity-Centric Information Extraction

17 Apr 2021EMNLP 2021 11arXiv:2104.08656archive 2025-07-28

Wenxuan Zhou, Muhao Chen

Recent information extraction approaches have relied on training deep neural models. However, such models can easily overfit noisy labels and suffer from performance degradation. While it is very costly to filter noisy labels in large learning resources, recent studies show that such labels take more training steps to be memorized and are more frequently forgotten than clean labels, therefore are identifiable in training. Motivated by such properties, we propose a simple co-regularization framework for entity-centric information extraction, which consists of several neural models with identical structures but different parameter initialization. These models are jointly optimized with the task-specific losses and are regularized to generate similar predictions based on an agreement loss, which prevents overfitting on noisy labels. Extensive experiments on two widely used but noisy benchmarks for information extraction, TACRED and CoNLL03, demonstrate the effectiveness of our framework. We release our code to the community for future research.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

wzhouad/NLL-IE officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Named Entity Recognition (NER)Relation Extraction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) CoNLL 2003 (English) Co-regularized LUKE F1 94.22 #3 of 73 Archive leaderboard report
Named Entity Recognition (NER) CoNLL++ Noise-robust Co-regularization + LUKE F1 95.60 #3 of 11 Archive leaderboard report
Named Entity Recognition (NER) CoNLL++ Noise-robust Co-regularization + BERT-large F1 94.04 #8 of 11 Archive leaderboard report
Relation Extraction TACRED Noise-robust Co-regularization + BERT-large F1 73.0 #12 of 40 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections