{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/med-unic-unifying-cross-lingual-medical-1","title":"Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias","arxiv_id":"2305.19894","date":"2023-05-31","proceeding":"NeurIPS 2023 11","authors":["Zhongwei Wan","Che Liu","Mi Zhang","Jie Fu","Benyou Wang","Sibo Cheng","Lei Ma","César Quilodrán-Casas","Rossella Arcucci"],"abstract":"The scarcity of data presents a critical obstacle to the efficacy of medical visionlanguage pre-training (VLP). A potential solution lies in the combination of datasets from various language communities. Nevertheless, the main challenge stems from the complexity of integrating diverse syntax and semantics, language-specific medical terminology, and culture-specific implicit knowledge. Therefore, one crucial aspect to consider is the presence of community bias caused by different languages. This paper presents a novel framework named Unifying Cross-Lingual Medical Vision-Language Pre-Training (Med-UniC), designed to integrate multimodal medical data from the two most prevalent languages, English and Spanish. Specifically, we propose Cross-lingual Text Alignment Regularization (CTR) to explicitly unify cross-lingual semantic representations of medical reports originating from diverse language communities. CTR is optimized through latent language disentanglement, rendering our optimization objective to not depend on negative samples, thereby significantly mitigating the bias from determining positive-negative sample pairs within analogous medical reports. Furthermore, it ensures that the cross-lingual representation is not biased toward any specific language community. Med-UniC reaches superior performance across 5 medical image tasks and 10 datasets encompassing over 30 diseases, offering a versatile framework for unifying multi-modal medical data within diverse linguistic communities. The experimental outcomes highlight the presence of community bias in cross-lingual VLP. Reducing this bias enhances the performance not only in vision-language tasks but also in uni-modal visual tasks.","url_abs":"https://arxiv.org/abs/2305.19894v3","url_pdf":"https://arxiv.org/pdf/2305.19894v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"med-unic-unifying-cross-lingual-medical-1","repo_url":"https://github.com/SUSTechBruce/Med-UniC","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"disentanglement","task_name":"Disentanglement"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2305.19894","atlas_url":"https://app.syntology.ai/?focus=2305.19894","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.19894"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/SUSTechBruce/Med-UniC","reach":null}],"summary":{"ran_violates":1,"ran":1,"unverified":2},"by_repo_kind":{"official":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1846a09dc0fdcb18","entry":"sigmoid","repo":"sustechbruce/med-unic","repo_kind":"official","path":"zero-shot/zero_shot.py","file_url":"https://github.com/sustechbruce/med-unic/blob/HEAD/zero-shot/zero_shot.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":2,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1846a09dc0fdcb18"}},{"code_sha256_prefix":"74c4e370c4bf9d9a","entry":"Language_discriminator","repo":"SUSTechBruce/Med-UniC","repo_kind":"official","path":"finetune/downstream_tasks/mgca/models/mgca/med_unic_model.py","file_url":"https://github.com/SUSTechBruce/Med-UniC/blob/HEAD/finetune/downstream_tasks/mgca/models/mgca/med_unic_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74c4e370c4bf9d9a"}},{"code_sha256_prefix":"bc60f10026a470a1","entry":"predict","repo":"sustechbruce/med-unic","repo_kind":"official","path":"zero-shot/zero_shot.py","file_url":"https://github.com/sustechbruce/med-unic/blob/HEAD/zero-shot/zero_shot.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc60f10026a470a1"}},{"code_sha256_prefix":"436e80777234abe0","entry":"zeroshot_classifier","repo":"sustechbruce/med-unic","repo_kind":"official","path":"zero-shot/zero_shot.py","file_url":"https://github.com/sustechbruce/med-unic/blob/HEAD/zero-shot/zero_shot.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"436e80777234abe0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}