{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/groupnet-multiscale-hypergraph-neural","title":"GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoning","arxiv_id":"2204.08770","date":"2022-04-19","proceeding":"CVPR 2022 1","authors":["Chenxin Xu","Maosen Li","Zhenyang Ni","Ya zhang","Siheng Chen"],"abstract":"Demystifying the interactions among multiple agents from their past trajectories is fundamental to precise and interpretable trajectory prediction. However, previous works only consider pair-wise interactions with limited relational reasoning. To promote more comprehensive interaction modeling for relational reasoning, we propose GroupNet, a multiscale hypergraph neural network, which is novel in terms of both interaction capturing and representation learning. From the aspect of interaction capturing, we propose a trainable multiscale hypergraph to capture both pair-wise and group-wise interactions at multiple group sizes. From the aspect of interaction representation learning, we propose a three-element format that can be learnt end-to-end and explicitly reason some relational factors including the interaction strength and category. We apply GroupNet into both CVAE-based prediction system and previous state-of-the-art prediction systems for predicting socially plausible trajectories with relational reasoning. To validate the ability of relational reasoning, we experiment with synthetic physics simulations to reflect the ability to capture group behaviors, reason interaction strength and interaction category. To validate the effectiveness of prediction, we conduct extensive experiments on three real-world trajectory prediction datasets, including NBA, SDD and ETH-UCY; and we show that with GroupNet, the CVAE-based prediction system outperforms state-of-the-art methods. We also show that adding GroupNet will further improve the performance of previous state-of-the-art prediction systems.","url_abs":"https://arxiv.org/abs/2204.08770v2","url_pdf":"https://arxiv.org/pdf/2204.08770v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"groupnet-multiscale-hypergraph-neural","repo_url":"https://github.com/mediabrain-sjtu/groupnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"relational-reasoning","task_name":"Relational Reasoning"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"trajectory-prediction","task_name":"Trajectory Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.08770","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.08770"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mediabrain-sjtu/groupnet","reach":null}],"summary":{"ran":7,"ran_draft_wrong":5,"unverified":7},"by_repo_kind":{"official":{"samples":19,"ran":12,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e3e7054af55c8e24","entry":"DecomposeBlock","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3e7054af55c8e24"}},{"code_sha256_prefix":"02e5a62dbbc9ab28","entry":"MLP","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02e5a62dbbc9ab28"}},{"code_sha256_prefix":"79cb60aaae6dc184","entry":"MLP2","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"79cb60aaae6dc184"}},{"code_sha256_prefix":"e1b62c2a7bfe079b","entry":"MLP_dict_softmax","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1b62c2a7bfe079b"}},{"code_sha256_prefix":"f14cfe7a9278509d","entry":"Normal","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f14cfe7a9278509d"}},{"code_sha256_prefix":"c4350ee83527a499","entry":"PositionalAgentEncoding","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4350ee83527a499"}},{"code_sha256_prefix":"115943afcd1d7f92","entry":"edge_aggregation","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"115943afcd1d7f92"}},{"code_sha256_prefix":"3ab88254add4c192","entry":"encode_onehot","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3ab88254add4c192"}},{"code_sha256_prefix":"422ac583248740e3","entry":"gumbel_softmax","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"422ac583248740e3"}},{"code_sha256_prefix":"2cecb1236580790d","entry":"gumbel_softmax_sample","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cecb1236580790d"}},{"code_sha256_prefix":"2d3a9f3a787bd820","entry":"my_softmax","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d3a9f3a787bd820"}},{"code_sha256_prefix":"3a4679b159e12db9","entry":"sample_gumbel","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a4679b159e12db9"}},{"code_sha256_prefix":"f6bd7ed0195d6371","entry":"Decoder","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6bd7ed0195d6371"}},{"code_sha256_prefix":"3f701c6c089fdec8","entry":"FutureEncoder","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f701c6c089fdec8"}},{"code_sha256_prefix":"5924141847b3fa88","entry":"GroupNet","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5924141847b3fa88"}},{"code_sha256_prefix":"3a8a6ecf7bac048a","entry":"MS_HGNN_hyper","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a8a6ecf7bac048a"}},{"code_sha256_prefix":"4eb731b79e21f6be","entry":"MS_HGNN_oridinary","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4eb731b79e21f6be"}},{"code_sha256_prefix":"4e8c0eb4817fc6f3","entry":"PastEncoder","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e8c0eb4817fc6f3"}},{"code_sha256_prefix":"439a7633d36b0d3d","entry":"initialize_weights","repo":"mediabrain-sjtu/groupnet","repo_kind":"official","path":"model/GroupNet_nba.py","file_url":"https://github.com/mediabrain-sjtu/groupnet/blob/HEAD/model/GroupNet_nba.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"439a7633d36b0d3d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}