Papers › NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data

NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data

23 Feb 2024arXiv:2402.15343archive 2025-07-28

Sergei Bogdanov, Alexandre Constantin, Timothée Bernard, Benoit Crabbé, Etienne Bernard

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation model specialized in the Named Entity Recognition (NER) task. NuNER can be fine-tuned to solve downstream NER problems in a data-efficient way, outperforming similar-sized foundation models in the few-shot regime and competing with much larger LLMs. We find that the size and entity-type diversity of the pre-training dataset are key to achieving good performance. We view NuNER as a member of the broader family of task-specific foundation models, recently unlocked by LLMs.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Serega6678/NuNER officialmentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DiversityFew-shot NERNERNamed Entity RecognitionNamed Entity Recognition (NER)Zero-shot Named Entity Recognition (NER)named-entity-recognition

Datasets

Introduced by this paper, per the archive.

NuNER

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Few-shot NER Few-NERD (INTER) NuNER 10 way 1~2 shot 66.54±0.40 #3 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTER) NuNER 10 way 5~10 shot 71.04±0.14 #3 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTER) NuNER 5 way 1~2 shot 67.37±0.31 #3 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTER) NuNER 5 way 5~10 shot 73.50±0.09 #3 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTRA) NuNER 10 way 1~2 shot 57.63±0.38 #2 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTRA) NuNER 10 way 5~10 shot 62.99±0.27 #2 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTRA) NuNER 5 way 1~2 shot 62.48±0.28 #2 of 13 Archive leaderboard report
Few-shot NER Few-NERD (INTRA) NuNER 5 way 5~10 shot 69.16±0.28 #2 of 13 Archive leaderboard report
Named Entity Recognition (NER) Few-NERD (SUP) NuNER F1-Measure 69.4 #3 of 6 Archive leaderboard report
Named Entity Recognition (NER) Few-NERD (SUP) NuNER Precision 67.8 #3 of 6 Archive leaderboard report
Named Entity Recognition (NER) Few-NERD (SUP) NuNER Recall 71.1 #3 of 6 Archive leaderboard report
Named Entity Recognition (NER) NCBI-disease NuNER Zero Span F1 61.1 #26 of 26 Archive leaderboard report
Named Entity Recognition (NER) Ontonotes v5 (English) NuNER F1 89.1 #16 of 28 Archive leaderboard report
Named Entity Recognition (NER) Ontonotes v5 (English) NuNER Precision 87.8 #16 of 28 Archive leaderboard report
Named Entity Recognition (NER) Ontonotes v5 (English) NuNER Recall 90.5 #16 of 28 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) Broad Twitter Corpus NuNerZero Span Entity F1 60.2 #1 of 2 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) CrossNER NuNERZero span AI 61.7 #1 of 4 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) CrossNER NuNERZero span Literature 64.9 #1 of 4 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) CrossNER NuNERZero span Music 69.9 #1 of 4 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) CrossNER NuNERZero span Politics 71.7 #1 of 4 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) CrossNER NuNERZero span Science 65.4 #1 of 4 Archive leaderboard report
Zero-shot Named Entity Recognition (NER) HarveyNER NuNER Zero Span Entity F1 24.9 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections