{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-dynamic-graph-representation-of","title":"Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention","arxiv_id":"2105.13495","date":"2021-05-27","proceeding":"NeurIPS 2021 12","authors":["Byung-Hoon Kim","Jong Chul Ye","Jae-Jin Kim"],"abstract":"Functional connectivity (FC) between regions of the brain can be assessed by the degree of temporal correlation measured with functional neuroimaging modalities. Based on the fact that these connectivities build a network, graph-based approaches for analyzing the brain connectome have provided insights into the functions of the human brain. The development of graph neural networks (GNNs) capable of learning representation from graph structured data has led to increased interest in learning the graph representation of the brain connectome. Although recent attempts to apply GNN to the FC network have shown promising results, there is still a common limitation that they usually do not incorporate the dynamic characteristics of the FC network which fluctuates over time. In addition, a few studies that have attempted to use dynamic FC as an input for the GNN reported a reduction in performance compared to static FC methods, and did not provide temporal explainability. Here, we propose STAGIN, a method for learning dynamic graph representation of the brain connectome with spatio-temporal attention. Specifically, a temporal sequence of brain graphs is input to the STAGIN to obtain the dynamic graph representation, while novel READOUT functions and the Transformer encoder provide spatial and temporal explainability with attention, respectively. Experiments on the HCP-Rest and the HCP-Task datasets demonstrate exceptional performance of our proposed method. Analysis of the spatio-temporal attention also provide concurrent interpretation with the neuroscientific knowledge, which further validates our method. Code is available at https://github.com/egyptdj/stagin","url_abs":"https://arxiv.org/abs/2105.13495v2","url_pdf":"https://arxiv.org/pdf/2105.13495v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-dynamic-graph-representation-of","repo_url":"https://github.com/egyptdj/stagin","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"learning-dynamic-graph-representation-of","repo_url":"https://github.com/summerwings/cdgin","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":null,"task_name":"Functional Connectivity"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2105.13495","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.13495"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/egyptdj/stagin","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/summerwings/cdgin","reach":null}],"summary":{"ran":12,"ran_honours":1,"unverified":2},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1},"listed":{"samples":11,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":15,"samples":[{"code_sha256_prefix":"c7794a32fc398023","entry":"CL_MLP","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c7794a32fc398023"}},{"code_sha256_prefix":"44ecc65021788153","entry":"LayerGIN","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"44ecc65021788153"}},{"code_sha256_prefix":"fc5fbcce16d4f1f6","entry":"ModuleFusion","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc5fbcce16d4f1f6"}},{"code_sha256_prefix":"af27625e1c1da111","entry":"ModuleGARO","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"af27625e1c1da111"}},{"code_sha256_prefix":"8852ed5fb37bb4ba","entry":"ModuleMeanReadout","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8852ed5fb37bb4ba"}},{"code_sha256_prefix":"61c36fd5f2765068","entry":"ModuleSERO","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"61c36fd5f2765068"}},{"code_sha256_prefix":"fd1f1a2352953434","entry":"ModuleSumReadout","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fd1f1a2352953434"}},{"code_sha256_prefix":"5b36578d41bd3a30","entry":"ModuleTimestamping","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b36578d41bd3a30"}},{"code_sha256_prefix":"84a3e8003fcb5340","entry":"ModuleTimestamping","repo":"egyptdj/stagin","repo_kind":"official","path":"model.py","file_url":"https://github.com/egyptdj/stagin/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"84a3e8003fcb5340"}},{"code_sha256_prefix":"a2b5e9d3759d13f5","entry":"ModuleTransformer","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a2b5e9d3759d13f5"}},{"code_sha256_prefix":"430499354e73b4a5","entry":"ModuleTransformer","repo":"egyptdj/stagin","repo_kind":"official","path":"model.py","file_url":"https://github.com/egyptdj/stagin/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"430499354e73b4a5"}},{"code_sha256_prefix":"fea2fca6373c48d7","entry":"Percentile","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fea2fca6373c48d7"}},{"code_sha256_prefix":"8f101e1712844130","entry":"count_parameters","repo":"egyptdj/stagin","repo_kind":"official","path":"model.py","file_url":"https://github.com/egyptdj/stagin/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"8f101e1712844130"}},{"code_sha256_prefix":"007776ff55ed978a","entry":"ModelCDGIN","repo":"summerwings/cdgin","repo_kind":"listed","path":"net/CDGIN.py","file_url":"https://github.com/summerwings/cdgin/blob/HEAD/net/CDGIN.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"007776ff55ed978a"}},{"code_sha256_prefix":"1a6ed53e10fc4d86","entry":"ModelSTAGIN","repo":"egyptdj/stagin","repo_kind":"official","path":"model.py","file_url":"https://github.com/egyptdj/stagin/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"1a6ed53e10fc4d86"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}