{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-19618","title":"Pragmatic Heterogeneous Collaborative Perception via Generative Communication Mechanism","arxiv_id":"2510.19618","date":"2025-10-22","proceeding":"NeurIPS","authors":["Junfei Zhou","Penglin Dai","Quanmin Wei","Bingyi Liu","Xiao Wu","Jianping Wang"],"abstract":"Multi-agent collaboration enhances the perception capabilities of individual agents through information sharing. However, in real-world applications, differences in sensors and models across heterogeneous agents inevitably lead to domain gaps during collaboration. Existing approaches based on adaptation and reconstruction fail to support pragmatic heterogeneous collaboration due to two key limitations: (1) Intrusive retraining of the encoder or core modules disrupts the established semantic consistency among agents; and (2) accommodating new agents incurs high computational costs, limiting scalability. To address these challenges, we present a novel Generative Communication mechanism (GenComm) that facilitates seamless perception across heterogeneous multi-agent systems through feature generation, without altering the original network, and employs lightweight numerical alignment of spatial information to efficiently integrate new agents at minimal cost. Specifically, a tailored Deformable Message Extractor is designed to extract spatial message for each collaborator, which is then transmitted in place of intermediate features. The Spatial-Aware Feature Generator, utilizing a conditional diffusion model, generates features aligned with the ego agent's semantic space while preserving the spatial information of the collaborators. These generated features are further refined by a Channel Enhancer before fusion. Experiments conducted on the OPV2V-H, DAIR-V2X and V2X-Real datasets demonstrate that GenComm outperforms existing state-of-the-art methods, achieving an 81% reduction in both computational cost and parameter count when incorporating new agents. Our code is available at https://github.com/jeffreychou777/GenComm.","url_abs":"https://arxiv.org/abs/2510.19618","url_pdf":"https://arxiv.org/pdf/2510.19618","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.19618","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.19618"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/jeffreychou777/GenComm","reach":null}],"summary":{"ran":4,"ran_draft_wrong":1,"ran_fixture":1,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"d4886c3d9b64d574","entry":"AttnBlock","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d4886c3d9b64d574"}},{"code_sha256_prefix":"5f153e95f5e79f1c","entry":"Config","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5f153e95f5e79f1c"}},{"code_sha256_prefix":"f60cc89459de85bb","entry":"Normalize","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f60cc89459de85bb"}},{"code_sha256_prefix":"685c42df569357ef","entry":"ResnetBlock","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"685c42df569357ef"}},{"code_sha256_prefix":"726c85e75dfdfeb8","entry":"Upsample","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"726c85e75dfdfeb8"}},{"code_sha256_prefix":"b77c75490c4e7bc2","entry":"get_timestep_embedding","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b77c75490c4e7bc2"}},{"code_sha256_prefix":"4b98bedae393f4b9","entry":"DiffusionUNet","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4b98bedae393f4b9"}},{"code_sha256_prefix":"6830d95cbfa7e4f6","entry":"GenComm","repo":"jeffreychou777/GenComm","repo_kind":"found_in_text","path":"opencood/models/gencomm_modules/cond_diff.py","file_url":"https://github.com/jeffreychou777/GenComm/blob/HEAD/opencood/models/gencomm_modules/cond_diff.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6830d95cbfa7e4f6"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}