{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-02737","title":"Unveiling and Bridging the Functional Perception Gap in MLLMs: Atomic Visual Alignment and Hierarchical Evaluation via PET-Bench","arxiv_id":"2601.02737","date":"2026-01-06","proceeding":null,"authors":["Zanting Ye","Xiaolong Niu","Xuanbin Wu","Xu Han","Shengyuan Liu","Jing Hao","Zhihao Peng","Hao Sun","Jieqin Lv","Fanghu Wang","Yanchao Huang","Hubing Wu","Yixuan Yuan","Habib Zaidi","Arman Rahmim","Yefeng Zheng","Lijun Lu"],"abstract":"While Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in tasks such as abnormality detection and report generation for anatomical modalities, their capability in functional imaging remains largely unexplored. In this work, we identify and quantify a fundamental functional perception gap: the inability of current vision encoders to decode functional tracer biodistribution independent of morphological priors. Identifying Positron Emission Tomography (PET) as the quintessential modality to investigate this disconnect, we introduce PET-Bench, the first large-scale functional imaging benchmark comprising 52,308 hierarchical QA pairs from 9,732 multi-site, multi-tracer PET studies. Extensive evaluation of 19 state-of-the-art MLLMs reveals a critical safety hazard termed the Chain-of-Thought (CoT) hallucination trap. We observe that standard CoT prompting, widely considered to enhance reasoning, paradoxically decouples linguistic generation from visual evidence in PET, producing clinically fluent but factually ungrounded diagnoses. To resolve this, we propose Atomic Visual Alignment (AVA), a simple fine-tuning strategy that enforces the mastery of low-level functional perception prior to high-level diagnostic reasoning. Our results demonstrate that AVA effectively bridges the perception gap, transforming CoT from a source of hallucination into a robust inference tool and improving diagnostic accuracy by up to 14.83%. Code and data are available at https://github.com/yezanting/PET-Bench.","url_abs":"https://arxiv.org/abs/2601.02737","url_pdf":"https://arxiv.org/pdf/2601.02737","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2601.02737","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.02737"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/yezanting/PET-Bench","reach":{"status":"ok"}}],"summary":{"unverified":10},"by_repo_kind":{"found_in_text":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"0b396c649e67034e","entry":"format_prompt_for_multilabel_vqa","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b396c649e67034e"}},{"code_sha256_prefix":"fa3d517bfb422a83","entry":"format_prompt_for_vqa","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fa3d517bfb422a83"}},{"code_sha256_prefix":"2f10c443853344a2","entry":"format_prompt_for_vqa","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2f10c443853344a2"}},{"code_sha256_prefix":"80e5ab98e60023f2","entry":"format_prompt_for_vqa_with_cot","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose_CoT.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose_CoT.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"80e5ab98e60023f2"}},{"code_sha256_prefix":"986a06b292be8f10","entry":"get_predicted_categories_multilabel","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"986a06b292be8f10"}},{"code_sha256_prefix":"6b879008bbc802b1","entry":"get_predicted_category","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b879008bbc802b1"}},{"code_sha256_prefix":"58510e587f4b2160","entry":"get_predicted_category","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"58510e587f4b2160"}},{"code_sha256_prefix":"8ebd6ca5daff074e","entry":"parse_model_answer","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level1_PET_tracer_identification.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ebd6ca5daff074e"}},{"code_sha256_prefix":"4e32299c3c2732e8","entry":"parse_model_answer","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level5_PET_cancer_diagnose.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4e32299c3c2732e8"}},{"code_sha256_prefix":"888eb67d970417a7","entry":"parse_model_answer_multilabel","repo":"yezanting/PET-Bench","repo_kind":"found_in_text","path":"eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","file_url":"https://github.com/yezanting/PET-Bench/blob/HEAD/eval_code/Lingshu-7B/Lingshu7B_eval_level2_PET_image_quality_v2_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"888eb67d970417a7"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}