{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cares-a-comprehensive-benchmark-of","title":"CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models","arxiv_id":"2406.06007","date":"2024-06-10","proceeding":null,"authors":["Peng Xia","Ze Chen","Juanxi Tian","Yangrui Gong","Ruibo Hou","Yue Xu","Zhenbang Wu","Zhiyuan Fan","Yiyang Zhou","Kangyu Zhu","Wenhao Zheng","Zhaoyang Wang","Xiao Wang","Xuchao Zhang","Chetan Bansal","Marc Niethammer","Junzhou Huang","Hongtu Zhu","Yun Li","Jimeng Sun","ZongYuan Ge","Gang Li","James Zou","Huaxiu Yao"],"abstract":"Artificial intelligence has significantly impacted medical applications, particularly with the advent of Medical Large Vision Language Models (Med-LVLMs), sparking optimism for the future of automated and personalized healthcare. However, the trustworthiness of Med-LVLMs remains unverified, posing significant risks for future model deployment. In this paper, we introduce CARES and aim to comprehensively evaluate the Trustworthiness of Med-LVLMs across the medical domain. We assess the trustworthiness of Med-LVLMs across five dimensions, including trustfulness, fairness, safety, privacy, and robustness. CARES comprises about 41K question-answer pairs in both closed and open-ended formats, covering 16 medical image modalities and 27 anatomical regions. Our analysis reveals that the models consistently exhibit concerns regarding trustworthiness, often displaying factual inaccuracies and failing to maintain fairness across different demographic groups. Furthermore, they are vulnerable to attacks and demonstrate a lack of privacy awareness. We publicly release our benchmark and code in https://cares-ai.github.io/.","url_abs":"https://arxiv.org/abs/2406.06007v3","url_pdf":"https://arxiv.org/pdf/2406.06007v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cares-a-comprehensive-benchmark-of","repo_url":"https://github.com/richard-peng-xia/cares","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"fairness","task_name":"Fairness"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.06007","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.06007"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/richard-peng-xia/CARES","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/richard-peng-xia/cares","reach":null}],"summary":{"ran_honours":2,"ran_draft_wrong":2,"ran_violates":1},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"6a6b36d9f33ea64a","entry":"find_most_similar_index","repo":"richard-peng-xia/CARES","repo_kind":"official","path":"src/eval/eval_multichoice.py","file_url":"https://github.com/richard-peng-xia/CARES/blob/HEAD/src/eval/eval_multichoice.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"CC-BY-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"6a6b36d9f33ea64a"}},{"code_sha256_prefix":"a5a244faae7f3633","entry":"generate_responses","repo":"richard-peng-xia/cares","repo_kind":"official","path":"src/eval/eval_uncertainty.py","file_url":"https://github.com/richard-peng-xia/cares/blob/HEAD/src/eval/eval_uncertainty.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"CC-BY-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a5a244faae7f3633"}},{"code_sha256_prefix":"66ac254ec06f36da","entry":"is_refused_response","repo":"richard-peng-xia/CARES","repo_kind":"official","path":"src/eval/eval_abs.py","file_url":"https://github.com/richard-peng-xia/CARES/blob/HEAD/src/eval/eval_abs.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"CC-BY-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"66ac254ec06f36da"}},{"code_sha256_prefix":"ed60b77b1a3f750d","entry":"load_test_data","repo":"richard-peng-xia/CARES","repo_kind":"official","path":"src/eval/eval_multichoice.py","file_url":"https://github.com/richard-peng-xia/CARES/blob/HEAD/src/eval/eval_multichoice.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"CC-BY-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"ed60b77b1a3f750d"}},{"code_sha256_prefix":"2f7829f62b92f768","entry":"str_similarity","repo":"richard-peng-xia/CARES","repo_kind":"official","path":"src/eval/eval_multichoice.py","file_url":"https://github.com/richard-peng-xia/CARES/blob/HEAD/src/eval/eval_multichoice.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"CC-BY-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"2f7829f62b92f768"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}