{"url":"/dataset/bc7-nlm-chem","name":"BC7 NLM-Chem","full_name":"BioCreative VII NLM-Chem","description_markdown":"Full-text chemical identification and indexing in PubMed articles.\r\n\r\nIdentifying named entities is an important building block for many complex knowledge extraction tasks. Errors in identifying relevant biomedical entities is a key impediment to accurate article retrieval, classification, and further understanding of textual semantics, such as relation extraction. Chemical entities appear throughout the biomedical research literature and are one of the entity types most frequently searched in PubMed. Accurate automated identification of the chemicals mentioned in journal publications has the potential to translate to improvements in many downstream NLP tasks and biomedical fields; in the near-term, specifically in the retrieval of relevant articles, greatly assisting researchers, indexers, and curators.\r\n\r\nThe NLM-CHEM track will consist of two tasks. Participants can choose to participate in either one or both. These tasks are:\r\n\r\nChemical identification in full text: predicting all chemicals mentioned in recently published full-text articles, both span (i.e. named entity recognition) and normalization (i.e. entity linking) using MeSH.\r\n\r\nChemical indexing prediction task: predicting which chemicals mentioned in recently published full-text articles should be indexed, i.e. appear in the listing of MeSH terms for the document.","description_withheld":null,"homepage":"https://biocreative.bioinformatics.udel.edu/tasks/biocreative-vii/track-2/","introduced_date":"2021-04-20","introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[{"name":"Texts","url":"/datasets/modality/texts"},{"name":"Biomedical","url":"/datasets/modality/biomedical"}],"tasks":[{"name":"Named Entity Recognition (NER)","url":"/task/named-entity-recognition-ner","datasets_with_task":"/datasets/task/named-entity-recognition-ner"},{"name":"Entity Linking","url":"/task/entity-linking","datasets_with_task":"/datasets/task/entity-linking"},{"name":"Chemical Indexing","url":"/task/chemical-indexing","datasets_with_task":"/datasets/task/chemical-indexing"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["BC7 NLM-Chem"],"data_loaders":[],"num_papers_in_archive":2,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/chemical-indexing-on-bc7-nlm-chem","task":"Chemical Indexing","dataset_variant":"BC7 NLM-Chem","rows":2,"metrics":["F1-score (strict)"],"first_row_in_archive_order":{"model":"Rule-based","paper":"/paper/chemical-identification-and-indexing-in-1","metrics":{"F1-score (strict)":"0.4849"},"code_links":[{"title":"bioinformatics-ua/biocreativeVII_track2","url":"https://github.com/bioinformatics-ua/biocreativeVII_track2"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/entity-linking-on-bc7-nlm-chem","task":"Entity Linking","dataset_variant":"BC7 NLM-Chem","rows":2,"metrics":["F1-score (strict)"],"first_row_in_archive_order":{"model":"Sieve-based+SapBERT","paper":"/paper/chemical-identification-and-indexing-in-1","metrics":{"F1-score (strict)":"0.8275"},"code_links":[{"title":"bioinformatics-ua/biocreativeVII_track2","url":"https://github.com/bioinformatics-ua/biocreativeVII_track2"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/named-entity-recognition-on-bc7-nlm-chem","task":"Named Entity Recognition (NER)","dataset_variant":"BC7 NLM-Chem","rows":2,"metrics":["F1-score (strict)"],"first_row_in_archive_order":{"model":"PubMedBERT+MLP+CRF","paper":"/paper/chemical-identification-and-indexing-in-1","metrics":{"F1-score (strict)":"0.8731"},"code_links":[{"title":"bioinformatics-ua/biocreativeVII_track2","url":"https://github.com/bioinformatics-ua/biocreativeVII_track2"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers_with_a_benchmark_row":[{"paper":"/paper/chemical-identification-and-indexing-in-1","title":"Chemical identification and indexing in PubMed full-text articles using deep learning and heuristics","date":"2022-07-01","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/chemical-detection-and-indexing-in-pubmed","title":"Chemical detection and indexing in PubMed full text articles using deep learning and rule-based methods","date":"2021-11-08","rows_on_this_dataset":3,"code_links":0,"syntology":null}],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}