{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/seeing-the-forest-and-the-tree-building","title":"Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers","arxiv_id":"2206.06131","date":"2022-06-10","proceeding":null,"authors":["Ran Liu","Mehdi Azabou","Max Dabagia","Jingyun Xiao","Eva L. Dyer"],"abstract":"Complex time-varying systems are often studied by abstracting away from the dynamics of individual components to build a model of the population-level dynamics from the start. However, when building a population-level description, it can be easy to lose sight of each individual and how they contribute to the larger picture. In this paper, we present a novel transformer architecture for learning from time-varying data that builds descriptions of both the individual as well as the collective population dynamics. Rather than combining all of our data into our model at the onset, we develop a separable architecture that operates on individual time-series first before passing them forward; this induces a permutation-invariance property and can be used to transfer across systems of different size and order. After demonstrating that our model can be applied to successfully recover complex interactions and dynamics in many-body systems, we apply our approach to populations of neurons in the nervous system. On neural activity datasets, we show that our model not only yields robust decoding performance, but also provides impressive performance in transfer across recordings of different animals without any neuron-level correspondence. By enabling flexible pre-training that can be transferred to neural recordings of different size and order, our work provides a first step towards creating a foundation model for neural decoding.","url_abs":"https://arxiv.org/abs/2206.06131v2","url_pdf":"https://arxiv.org/pdf/2206.06131v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"seeing-the-forest-and-the-tree-building","repo_url":"https://github.com/nerdslab/EIT","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series","task_name":"Time Series Analysis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2206.06131","atlas_url":"https://app.syntology.ai/?focus=2206.06131","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.06131"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nerdslab/EIT","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8,"ran_violates":1,"unverified":2},"by_repo_kind":{"official":{"samples":11,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3f7682da16e16c04","entry":"bicubic_upsample","repo":"nerdslab/EIT","repo_kind":"official","path":"my_transformers/model_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/my_transformers/model_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f7682da16e16c04"}},{"code_sha256_prefix":"c6c224933f8c029e","entry":"compute_acc","repo":"nerdslab/EIT","repo_kind":"official","path":"my_transformers/tasks.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/my_transformers/tasks.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6c224933f8c029e"}},{"code_sha256_prefix":"cd81c1424a0abd75","entry":"compute_wasserstein_distance","repo":"nerdslab/EIT","repo_kind":"official","path":"ot_distance_funcs.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/ot_distance_funcs.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cd81c1424a0abd75"}},{"code_sha256_prefix":"53c1c93a6c13ac37","entry":"coords2state","repo":"nerdslab/EIT","repo_kind":"official","path":"synthetic_data_twobody.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/synthetic_data_twobody.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53c1c93a6c13ac37"}},{"code_sha256_prefix":"27e2bdc4ea1c263b","entry":"kinetic_energy","repo":"nerdslab/EIT","repo_kind":"official","path":"synthetic_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/synthetic_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"27e2bdc4ea1c263b"}},{"code_sha256_prefix":"6ba8cee9f5daea41","entry":"pair","repo":"nerdslab/EIT","repo_kind":"official","path":"my_transformers/model_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/my_transformers/model_utils.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6ba8cee9f5daea41"}},{"code_sha256_prefix":"9ee750447e957be5","entry":"plot_construct","repo":"nerdslab/EIT","repo_kind":"official","path":"my_transformers/tasks.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/my_transformers/tasks.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ee750447e957be5"}},{"code_sha256_prefix":"8d47c174ab87a469","entry":"potential_energy","repo":"nerdslab/EIT","repo_kind":"official","path":"synthetic_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/synthetic_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8d47c174ab87a469"}},{"code_sha256_prefix":"287e459510bf2466","entry":"total_energy","repo":"nerdslab/EIT","repo_kind":"official","path":"synthetic_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/synthetic_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"287e459510bf2466"}},{"code_sha256_prefix":"c864e744d77241f0","entry":"compute_OT","repo":"nerdslab/EIT","repo_kind":"official","path":"ot_distance_funcs.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/ot_distance_funcs.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c864e744d77241f0"}},{"code_sha256_prefix":"4de0dd48e0b9b65f","entry":"pixel_upsample","repo":"nerdslab/EIT","repo_kind":"official","path":"my_transformers/model_utils.py","file_url":"https://github.com/nerdslab/EIT/blob/HEAD/my_transformers/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4de0dd48e0b9b65f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}