{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-13288","title":"Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality","arxiv_id":"2606.13288","date":"2026-06-11","proceeding":null,"authors":["Wei Li","Zhen Huang","Xinmei Tian"],"abstract":"Contrastively trained vision-language models like CLIP, have made remarkable progress in learning joint image-text representations, but still face challenges in compositional understanding. They often exhibit a \"bag-of-words\" behavior--struggling to capture the object relations, attribute-object bindings, and word order dependencies. This limitation arises not only from the reliance on global, single-vector representations for optimization, but also from the insufficient exploitation and modeling of the rich compositional information inherently present in paired image text data. In this work, we propose MACCO (MAsked Compositional Concept MOdeling), a framework that masks compositional concepts in one modality and reconstructs them conditioned on the full contextual information from the other, enabling the model to capture and align cross-modal compositional structures more effectively. To facilitate this process, we introduce two auxiliary objectives that jointly align and regularize masked features both inter-modally and intra-modally. Extensive experiments on five compositional benchmarks, along with in-depth analyses, demonstrate that our approach not only significantly enhances compositionality in VLMs but also improves their ability to capture syntactic structure and linguistic information. Additionally, the improved compositionality also benefits text-to-image generation and multimodal large language model. Code is available at https://github.com/hiker-lw/MACCO.","url_abs":"https://arxiv.org/abs/2606.13288","url_pdf":"https://arxiv.org/pdf/2606.13288","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.13288","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.13288"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/hiker-lw/MACCO","reach":null}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8d56df7d1ead16e2","entry":"Image_Predictor","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8d56df7d1ead16e2"}},{"code_sha256_prefix":"b2bb1279ceae186b","entry":"ResidualAttentionBlock","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2bb1279ceae186b"}},{"code_sha256_prefix":"ebc90ef3d46558ff","entry":"ResidualCrossAttentionBlock","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ebc90ef3d46558ff"}},{"code_sha256_prefix":"1da41a5fb6e9d92c","entry":"Text_Predictor","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1da41a5fb6e9d92c"}},{"code_sha256_prefix":"7cfb16758d714b36","entry":"Transformer","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7cfb16758d714b36"}},{"code_sha256_prefix":"a210faa2dd758b01","entry":"VisualTransformer","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a210faa2dd758b01"}},{"code_sha256_prefix":"c88c1b3bdd5f5cc8","entry":"CLIP","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c88c1b3bdd5f5cc8"}},{"code_sha256_prefix":"1d5a413f69c86ee9","entry":"MACCO_CLIP_text_image","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d5a413f69c86ee9"}},{"code_sha256_prefix":"345c058dcabd105b","entry":"TimmModel","repo":"hiker-lw/MACCO","repo_kind":"found_in_text","path":"src/open_clip_code/MACCO_variant/MACCO_text_image.py","file_url":"https://github.com/hiker-lw/MACCO/blob/HEAD/src/open_clip_code/MACCO_variant/MACCO_text_image.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"345c058dcabd105b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}