{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-mutual-excitation-for-hand-to-hand","title":"Learning Mutual Excitation for Hand-to-Hand and Human-to-Human Interaction Recognition","arxiv_id":"2402.02431","date":"2024-02-04","proceeding":null,"authors":["Mengyuan Liu","Chen Chen","Songtao Wu","Fanyang Meng","Hong Liu"],"abstract":"Recognizing interactive actions, including hand-to-hand interaction and human-to-human interaction, has attracted increasing attention for various applications in the field of video analysis and human-robot interaction. Considering the success of graph convolution in modeling topology-aware features from skeleton data, recent methods commonly operate graph convolution on separate entities and use late fusion for interactive action recognition, which can barely model the mutual semantic relationships between pairwise entities. To this end, we propose a mutual excitation graph convolutional network (me-GCN) by stacking mutual excitation graph convolution (me-GC) layers. Specifically, me-GC uses a mutual topology excitation module to firstly extract adjacency matrices from individual entities and then adaptively model the mutual constraints between them. Moreover, me-GC extends the above idea and further uses a mutual feature excitation module to extract and merge deep features from pairwise entities. Compared with graph convolution, our proposed me-GC gradually learns mutual information in each layer and each stage of graph convolution operations. Extensive experiments on a challenging hand-to-hand interaction dataset, i.e., the Assembely101 dataset, and two large-scale human-to-human interaction datasets, i.e., NTU60-Interaction and NTU120-Interaction consistently verify the superiority of our proposed method, which outperforms the state-of-the-art GCN-based and Transformer-based methods.","url_abs":"https://arxiv.org/abs/2402.02431v2","url_pdf":"https://arxiv.org/pdf/2402.02431v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-mutual-excitation-for-hand-to-hand","repo_url":"https://github.com/nkliuyifang/me-gcn","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"human-interaction-recognition","task_name":"Human Interaction Recognition"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.02431","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.02431"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nkliuyifang/me-gcn","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"8b14974e8aa7320f","entry":"downsample","repo":"nkliuyifang/me-gcn","repo_kind":"official","path":"feeders/tools.py","file_url":"https://github.com/nkliuyifang/me-gcn/blob/HEAD/feeders/tools.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8b14974e8aa7320f"}},{"code_sha256_prefix":"ffed4f85d50832c9","entry":"import_class","repo":"nkliuyifang/me-gcn","repo_kind":"official","path":"model/baseline_ctrgcn_interaction_biBetaInit0_gama.py","file_url":"https://github.com/nkliuyifang/me-gcn/blob/HEAD/model/baseline_ctrgcn_interaction_biBetaInit0_gama.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ffed4f85d50832c9"}},{"code_sha256_prefix":"37939bae213ecfd4","entry":"valid_crop_resize","repo":"nkliuyifang/me-gcn","repo_kind":"official","path":"feeders/tools.py","file_url":"https://github.com/nkliuyifang/me-gcn/blob/HEAD/feeders/tools.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"37939bae213ecfd4"}},{"code_sha256_prefix":"2f7f389f0584c97e","entry":"temporal_slice","repo":"nkliuyifang/me-gcn","repo_kind":"official","path":"feeders/tools.py","file_url":"https://github.com/nkliuyifang/me-gcn/blob/HEAD/feeders/tools.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2f7f389f0584c97e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}