{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cxpmrg-bench-pre-training-and-benchmarking","title":"CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Dataset","arxiv_id":"2410.00379","date":"2024-10-01","proceeding":"CVPR 2025 1","authors":["Xiao Wang","Fuling Wang","Yuehang Li","Qingchuan Ma","Shiao Wang","Bo Jiang","Chuanfu Li","Jin Tang"],"abstract":"X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence which can significantly reduce diagnostic burdens and patient wait times. Despite significant progress, we believe that the task has reached a bottleneck due to the limited benchmark datasets and the existing large models' insufficient capability enhancements in this specialized domain. Specifically, the recently released CheXpert Plus dataset lacks comparative evaluation algorithms and their results, providing only the dataset itself. This situation makes the training, evaluation, and comparison of subsequent algorithms challenging. Thus, we conduct a comprehensive benchmarking of existing mainstream X-ray report generation models and large language models (LLMs), on the CheXpert Plus dataset. We believe that the proposed benchmark can provide a solid comparative basis for subsequent algorithms and serve as a guide for researchers to quickly grasp the state-of-the-art models in this field. More importantly, we propose a large model for the X-ray image report generation using a multi-stage pre-training strategy, including self-supervised autoregressive generation and Xray-report contrastive learning, and supervised fine-tuning. Extensive experimental results indicate that the autoregressive pre-training based on Mamba effectively encodes X-ray images, and the image-text contrastive pre-training further aligns the feature spaces, achieving better experimental results. Source code can be found on \\url{https://github.com/Event-AHU/Medical_Image_Analysis}.","url_abs":"https://arxiv.org/abs/2410.00379v1","url_pdf":"https://arxiv.org/pdf/2410.00379v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cxpmrg-bench-pre-training-and-benchmarking","repo_url":"https://github.com/event-ahu/medical_image_analysis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"diagnostic","task_name":"Diagnostic"},{"task_slug":"mamba","task_name":"Mamba"},{"task_slug":"medical-report-generation","task_name":"Medical Report Generation"}],"methods":[{"method_slug":"mamba","method_name":"Mamba"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2410.00379","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.00379"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/event-ahu/medical_image_analysis","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"ran_draft_wrong":1,"ran":3},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"56e674752db00649","entry":"generate_prompt","repo":"event-ahu/medical_image_analysis","repo_kind":"official","path":"EMRRG/finetune.py","file_url":"https://github.com/event-ahu/medical_image_analysis/blob/HEAD/EMRRG/finetune.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"56e674752db00649"}},{"code_sha256_prefix":"dadb8463d5b1149d","entry":"has_file_allowed_extension","repo":"event-ahu/medical_image_analysis","repo_kind":"official","path":"AM_MRG/SwinCheX/models/custom_image_folder.py","file_url":"https://github.com/event-ahu/medical_image_analysis/blob/HEAD/AM_MRG/SwinCheX/models/custom_image_folder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"dadb8463d5b1149d"}},{"code_sha256_prefix":"c7497af4b6ddc418","entry":"is_image_file","repo":"event-ahu/medical_image_analysis","repo_kind":"official","path":"AM_MRG/SwinCheX/models/custom_image_folder.py","file_url":"https://github.com/event-ahu/medical_image_analysis/blob/HEAD/AM_MRG/SwinCheX/models/custom_image_folder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"c7497af4b6ddc418"}},{"code_sha256_prefix":"bd37021c591b1975","entry":"make_dataset","repo":"event-ahu/medical_image_analysis","repo_kind":"official","path":"AM_MRG/SwinCheX/models/custom_image_folder.py","file_url":"https://github.com/event-ahu/medical_image_analysis/blob/HEAD/AM_MRG/SwinCheX/models/custom_image_folder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"bd37021c591b1975"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}