{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-00067","title":"Modality as Heterogeneity: Node Splitting and Graph Rewiring for Multimodal Graph Learning","arxiv_id":"2602.00067","date":"2026-01-20","proceeding":null,"authors":["Yihan Zhang","Ercan E. Kuruoglu"],"abstract":"Multimodal graphs are gaining increasing attention due to their rich representational power and wide applicability, yet they introduce substantial challenges arising from severe modality confusion. To address this issue, we propose NSG (Node Splitting Graph)-MoE, a multimodal graph learning framework that integrates a node-splitting and graph-rewiring mechanism with a structured Mixture-of-Experts (MoE) architecture. It explicitly decomposes each node into modality-specific components and assigns relation-aware experts to process heterogeneous message flows, thereby preserving structural information and multimodal semantics while mitigating the undesirable mixing effects commonly observed in general-purpose GNNs. Extensive experiments on three multimodal benchmarks demonstrate that NSG-MoE consistently surpasses strong baselines. Despite incorporating MoE -- which is typically computationally heavy -- our method achieves competitive training efficiency. Beyond empirical results, we provide a spectral analysis revealing that NSG performs adaptive filtering over modality-specific subspaces, thus explaining its disentangling behavior. Furthermore, an information-theoretic analysis shows that the architectural constraints imposed by NSG reduces mutual information between data and parameters and improving generalization capability.","url_abs":"https://arxiv.org/abs/2602.00067","url_pdf":"https://arxiv.org/pdf/2602.00067","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.00067","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.00067"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/zyh23-chn/NSG-MoE","reach":null}],"summary":{"ran":5,"ran_honours":2,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":10,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"29c43a186116779e","entry":"BaseNSG","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29c43a186116779e"}},{"code_sha256_prefix":"6701df08b2830421","entry":"GAT_h","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6701df08b2830421"}},{"code_sha256_prefix":"0ce5866f03880121","entry":"HAN","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0ce5866f03880121"}},{"code_sha256_prefix":"9d69e1508e783636","entry":"HGT","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9d69e1508e783636"}},{"code_sha256_prefix":"c2c1b589e00d8191","entry":"SAGE_h","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c2c1b589e00d8191"}},{"code_sha256_prefix":"f794a29c5858961a","entry":"maximum_spanning_tree","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f794a29c5858961a"}},{"code_sha256_prefix":"f3365a2dbe75c14a","entry":"pairwise_cos_sim","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f3365a2dbe75c14a"}},{"code_sha256_prefix":"8b1cfbfa6f5f6e71","entry":"tup2str","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8b1cfbfa6f5f6e71"}},{"code_sha256_prefix":"dfc1a9a567e75cd3","entry":"NSG_MOE","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dfc1a9a567e75cd3"}},{"code_sha256_prefix":"8207e6abfbd40d95","entry":"save_with_pickle","repo":"zyh23-chn/NSG-MoE","repo_kind":"found_in_text","path":"src/ud_models/nsg.py","file_url":"https://github.com/zyh23-chn/NSG-MoE/blob/HEAD/src/ud_models/nsg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8207e6abfbd40d95"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}