Papers › Focusing on Potential Named Entities During Active Label Acquisition

Focusing on Potential Named Entities During Active Label Acquisition

6 Nov 2021arXiv:2111.03837archive 2025-07-28

Ali Osman Berk Sapci, Oznur Tastan, Reyyan Yeniterzi

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive performances in NER, many domain-specific NER applications still call for a substantial amount of labeled data. Active learning (AL), a general framework for the label acquisition problem, has been used for NER tasks to minimize the annotation cost without sacrificing model performance. However, the heavily imbalanced class distribution of tokens introduces challenges in designing effective AL querying methods for NER. We propose several AL sentence query evaluation functions that pay more attention to potential positive tokens, and evaluate these proposed functions with both sentence-based and token-based cost evaluation strategies. We also propose a better data-driven normalization approach to penalize sentences that are too long or too short. Our experiments on three datasets from different domains reveal that the proposed approach reduces the number of annotated tokens while achieving better or comparable prediction performance with conventional methods.

PaperPDFCode

Code

bo1929/anelfop officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Active LearningNERNamed Entity RecognitionNamed Entity Recognition (NER)Sentencenamed-entity-recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) BC5CDR BERT-CRF F1 86 #16 of 16 Archive leaderboard report
Named Entity Recognition (NER) CoNLL 2003 (English) BERT-CRF F1 93.6 #17 of 73 Archive leaderboard report
Named Entity Recognition (NER) NCBI-disease BERT-CRF F1 84.5 #24 of 26 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections