Papers › Biomedical Named Entity Recognition at Scale

Biomedical Named Entity Recognition at Scale

12 Nov 2020arXiv:2011.06315archive 2025-07-28

Veysel Kocaman, David Talby

Named entity recognition (NER) is a widely applicable natural language processing task and building block of question answering, topic modeling, information retrieval, etc. In the medical domain, NER plays a crucial role by extracting meaningful chunks from clinical notes and reports, which are then fed to downstream tasks like assertion status detection, entity resolution, relation extraction, and de-identification. Reimplementing a Bi-LSTM-CNN-Char deep learning architecture on top of Apache Spark, we present a single trainable NER model that obtains new state-of-the-art results on seven public biomedical benchmarks without using heavy contextual embeddings like BERT. This includes improving BC4CHEMD to 93.72% (4.1% gain), Species800 to 80.91% (4.6% gain), and JNLPBA to 81.29% (5.2% gain). In addition, this model is freely available within a production-grade code base as part of the open-source Spark NLP library; can scale up for training and inference in any Spark cluster; has GPU support and libraries for popular programming languages such as Python, R, Scala and Java; and can be extended to support other human languages with no code changes.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

De-identificationEntity ResolutionInformation RetrievalMedical Named Entity RecognitionNERNamed Entity RecognitionNamed Entity Recognition (NER)Question AnsweringRelation ExtractionRetrievalnamed-entity-recognition

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Named Entity Recognition (NER) AnatEM BLSTM-CNN-Char (SparkNLP) F1 89.13 #3 of 5 Archive leaderboard report
Named Entity Recognition (NER) BC2GM Spark NLP F1 88.75 #1 of 13 Archive leaderboard report
Named Entity Recognition (NER) BC4CHEMD BLSTM-CNN-Char (SparkNLP) F1 93.72 #2 of 7 Archive leaderboard report
Named Entity Recognition (NER) BC5CDR BLSTM-CNN-Char (SparkNLP) F1 89.73 #8 of 16 Archive leaderboard report
Named Entity Recognition (NER) BC5CDR Spark NLP F1 89.73 #9 of 16 Archive leaderboard report
Named Entity Recognition (NER) BC5CDR-chemical Spark NLP F1 94.88 #1 of 13 Archive leaderboard report
Named Entity Recognition (NER) BioNLP13-CG BLSTM-CNN-Char (SparkNLP) F1 85.58 #1 of 3 Archive leaderboard report
Named Entity Recognition (NER) JNLPBA BLSTM-CNN-Char (SparkNLP) F1 81.29 #2 of 17 Archive leaderboard report
Named Entity Recognition (NER) JNLPBA Spark NLP F1 81.29 #3 of 17 Archive leaderboard report
Named Entity Recognition (NER) LINNAEUS BLSTM-CNN-Char (SparkNLP) F1 86.26 #1 of 6 Archive leaderboard report
Named Entity Recognition (NER) LINNAEUS Spark NLP F1 86.26 #2 of 6 Archive leaderboard report
Named Entity Recognition (NER) NCBI-disease BLSTM-CNN-Char (SparkNLP) F1 89.13 #4 of 26 Archive leaderboard report
Named Entity Recognition (NER) NCBI-disease Spark NLP F1 89.13 #5 of 26 Archive leaderboard report
Named Entity Recognition (NER) Species-800 Spark NLP F1 80.91 #4 of 4 Archive leaderboard report
Named Entity Recognition (NER) Species800 BLSTM-CNN-Char (SparkNLP) F1 80.91 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AdamAttentionAttention DropoutBERTDense ConnectionsDropoutLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSoftmaxWeight DecayWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections