{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-05308","title":"Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attribution","arxiv_id":"2603.05308","date":"2026-03-05","proceeding":null,"authors":["Qiao Jin","Yin Fang","Lauren He","Yifan Yang","Guangzhi Xiong","Zhizheng Wang","Nicholas Wan","Joey Chan","Donald C. Comeau","Robert Leaman","Charalampos S. Floudas","Aidong Zhang","Michael F. Chiang","Yifan Peng","Zhiyong Lu"],"abstract":"Assessing whether an article supports an assertion is essential for hallucination detection and claim verification. While large language models (LLMs) have the potential to automate this task, achieving strong performance requires frontier models such as GPT-5 that are prohibitively expensive to deploy at scale. To efficiently perform biomedical evidence attribution, we present Med-V1, a family of small language models with only three billion parameters. Trained on high-quality synthetic data newly developed in this study, Med-V1 substantially outperforms (+27.0% to +71.3%) its base models on five biomedical benchmarks unified into a verification format. Despite its smaller size, Med-V1 performs comparably to frontier LLMs such as GPT-5, along with high-quality explanations for its predictions. We use Med-V1 to conduct a first-of-its-kind use case study that quantifies hallucinations in LLM-generated answers under different citation instructions. Results show that the format instruction strongly affects citation validity and hallucination, with GPT-5 generating more claims but exhibiting hallucination rates similar to GPT-4o. Additionally, we present a second use case showing that Med-V1 can automatically identify high-stakes evidence misattributions in clinical practice guidelines, revealing potentially negative public health impacts that are otherwise challenging to identify at scale. Overall, Med-V1 provides an efficient and accurate lightweight alternative to frontier LLMs for practical and real-world applications in biomedical evidence attribution and verification tasks. Med-V1 is available at https://github.com/ncbi-nlp/Med-V1.","url_abs":"https://arxiv.org/abs/2603.05308","url_pdf":"https://arxiv.org/pdf/2603.05308","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.05308","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.05308"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ncbi-nlp/Med-V1","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":13},"by_repo_kind":{"found_in_text":{"samples":14,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"25f0ea3f460f6ce1","entry":"unpad_dataproto","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/protocol.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/protocol.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"25f0ea3f460f6ce1"}},{"code_sha256_prefix":"660713a8fa047736","entry":"get_generation_config","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/utils/model.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"660713a8fa047736"}},{"code_sha256_prefix":"fe79c459a3e4cc64","entry":"get_huggingface_actor_config","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/utils/model.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fe79c459a3e4cc64"}},{"code_sha256_prefix":"d3a115a1fc91bae3","entry":"get_med_v1_messages","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"utils.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d3a115a1fc91bae3"}},{"code_sha256_prefix":"af005d03c2088909","entry":"get_weight_loader","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/weight_loader_registry.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/weight_loader_registry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"af005d03c2088909"}},{"code_sha256_prefix":"0cc9aa000ef7d88e","entry":"get_weight_saver","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/weight_loader_registry.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/weight_loader_registry.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0cc9aa000ef7d88e"}},{"code_sha256_prefix":"7352f43d0a5f4491","entry":"init_mcore_model","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/mcore/registry.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/mcore/registry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7352f43d0a5f4491"}},{"code_sha256_prefix":"fcd502aa6ec64ff1","entry":"init_mcore_model_dense","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/mcore/model_initializer.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/mcore/model_initializer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"fcd502aa6ec64ff1"}},{"code_sha256_prefix":"1130ccf68867668b","entry":"init_mcore_model_llama4","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/mcore/model_initializer.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/mcore/model_initializer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1130ccf68867668b"}},{"code_sha256_prefix":"0427451a00a8e108","entry":"init_mcore_model_qwen2_moe","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/mcore/model_initializer.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/mcore/model_initializer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0427451a00a8e108"}},{"code_sha256_prefix":"d5a6f286ba2e7d66","entry":"load_json","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"utils.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d5a6f286ba2e7d66"}},{"code_sha256_prefix":"0d364d43436cf1dd","entry":"load_state_dict_to_megatron_gptmodel","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/models/mcore/loader.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/models/mcore/loader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d364d43436cf1dd"}},{"code_sha256_prefix":"e62cca418a7b8082","entry":"parse_llm_output","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"utils.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e62cca418a7b8082"}},{"code_sha256_prefix":"3b15e2ac7497c441","entry":"squeeze","repo":"ncbi-nlp/Med-V1","repo_kind":"found_in_text","path":"training/grpo/verl/utils/model.py","file_url":"https://github.com/ncbi-nlp/Med-V1/blob/HEAD/training/grpo/verl/utils/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b15e2ac7497c441"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}