{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/biomedrag-a-retrieval-augmented-large","title":"BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine","arxiv_id":"2405.00465","date":"2024-05-01","proceeding":null,"authors":["Mingchen Li","Halil Kilicoglu","Hua Xu","Rui Zhang"],"abstract":"Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations. Retrieval-augmented generation provided a solution for these models to update knowledge and enhance their performance. In contrast to previous retrieval-augmented LMs, which utilize specialized cross-attention mechanisms to help LLM encode retrieved text, BiomedRAG adopts a simpler approach by directly inputting the retrieved chunk-based documents into the LLM. This straightforward design is easily applicable to existing retrieval and language models, effectively bypassing noise information in retrieved documents, particularly in noise-intensive tasks. Moreover, we demonstrate the potential for utilizing the LLM to supervise the retrieval model in the biomedical domain, enabling it to retrieve the document that assists the LM in improving its predictions. Our experiments reveal that with the tuned scorer,\\textsc{ BiomedRAG} attains superior performance across 5 biomedical NLP tasks, encompassing information extraction (triple extraction, relation extraction), text classification, link prediction, and question-answering, leveraging over 9 datasets. For instance, in the triple extraction task, \\textsc{BiomedRAG} outperforms other triple extraction systems with micro-F1 scores of 81.42 and 88.83 on GIT and ChemProt corpora, respectively.","url_abs":"https://arxiv.org/abs/2405.00465v3","url_pdf":"https://arxiv.org/pdf/2405.00465v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"biomedrag-a-retrieval-augmented-large","repo_url":"https://github.com/toneli/petailor-for-bio-triple-extraction","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"},{"task_slug":"link-prediction","task_name":"Link Prediction"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"relation-extraction","task_name":"Relation Extraction"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"retrieval-augmented-generation","task_name":"Retrieval-augmented Generation"},{"task_slug":"text-classification","task_name":"Text Classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.00465","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.00465"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/toneli/petailor-for-bio-triple-extraction","reach":{"status":"ok"}}],"summary":{"ran":3,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"416adc8075a063ad","entry":"calclulate_f1","repo":"toneli/petailor-for-bio-triple-extraction","repo_kind":"official","path":"4_generation_triple_model/0_F1_triplet_evalution.py","file_url":"https://github.com/toneli/petailor-for-bio-triple-extraction/blob/HEAD/4_generation_triple_model/0_F1_triplet_evalution.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"416adc8075a063ad"}},{"code_sha256_prefix":"89629b110a6a8b55","entry":"cos_similisty","repo":"toneli/petailor-for-bio-triple-extraction","repo_kind":"official","path":"0_make_relation_chuck_and_scorer_data/2_make_similar_chuck_for_train_5.py","file_url":"https://github.com/toneli/petailor-for-bio-triple-extraction/blob/HEAD/0_make_relation_chuck_and_scorer_data/2_make_similar_chuck_for_train_5.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89629b110a6a8b55"}},{"code_sha256_prefix":"82613ffccd396680","entry":"formatting_func","repo":"toneli/petailor-for-bio-triple-extraction","repo_kind":"official","path":"3_trainning_triple_model/trainer.py","file_url":"https://github.com/toneli/petailor-for-bio-triple-extraction/blob/HEAD/3_trainning_triple_model/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"82613ffccd396680"}},{"code_sha256_prefix":"56babd0fe5ddc04c","entry":"prepare_data","repo":"toneli/petailor-for-bio-triple-extraction","repo_kind":"official","path":"3_trainning_triple_model/trainer.py","file_url":"https://github.com/toneli/petailor-for-bio-triple-extraction/blob/HEAD/3_trainning_triple_model/trainer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"56babd0fe5ddc04c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}