{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/blend-behavior-guided-neural-population","title":"BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation","arxiv_id":"2410.13872","date":"2024-10-02","proceeding":null,"authors":["Zhengrui Guo","Fangxu Zhou","Wei Wu","Qichen Sun","Lishuang Feng","Jinzhuo Wang","Hao Chen"],"abstract":"Modeling the nonlinear dynamics of neuronal populations represents a key pursuit in computational neuroscience. Recent research has increasingly focused on jointly modeling neural activity and behavior to unravel their interconnections. Despite significant efforts, these approaches often necessitate either intricate model designs or oversimplified assumptions. Given the frequent absence of perfectly paired neural-behavioral datasets in real-world scenarios when deploying these models, a critical yet understudied research question emerges: how to develop a model that performs well using only neural activity as input at inference, while benefiting from the insights gained from behavioral signals during training? To this end, we propose BLEND, the behavior-guided neural population dynamics modeling framework via privileged knowledge distillation. By considering behavior as privileged information, we train a teacher model that takes both behavior observations (privileged features) and neural activities (regular features) as inputs. A student model is then distilled using only neural activity. Unlike existing methods, our framework is model-agnostic and avoids making strong assumptions about the relationship between behavior and neural activity. This allows BLEND to enhance existing neural dynamics modeling architectures without developing specialized models from scratch. Extensive experiments across neural population activity modeling and transcriptomic neuron identity prediction tasks demonstrate strong capabilities of BLEND, reporting over 50% improvement in behavioral decoding and over 15% improvement in transcriptomic neuron identity prediction after behavior-guided distillation. Furthermore, we empirically explore various behavior-guided distillation strategies within the BLEND framework and present a comprehensive analysis of effectiveness and implications for model performance.","url_abs":"https://arxiv.org/abs/2410.13872v3","url_pdf":"https://arxiv.org/pdf/2410.13872v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"blend-behavior-guided-neural-population","repo_url":"https://github.com/dddavid4real/BLEND","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"time-series","task_name":"Time Series Analysis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.13872","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.13872"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/dddavid4real/BLEND","reach":null}],"summary":{"ran":4,"ran_violates":1,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a58c325e7ceeff07","entry":"PositionalEncoding","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a58c325e7ceeff07"}},{"code_sha256_prefix":"c6e50336678bd3b9","entry":"ScaleNorm","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c6e50336678bd3b9"}},{"code_sha256_prefix":"399ce0c84ef92e6e","entry":"TransformerEncoderLayerWithHooks","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"399ce0c84ef92e6e"}},{"code_sha256_prefix":"af5d8da6f90d2ea3","entry":"TransformerEncoderWithHooks","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"af5d8da6f90d2ea3"}},{"code_sha256_prefix":"534905c1bdb93a5e","entry":"binary_mask_to_attn_mask","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"534905c1bdb93a5e"}},{"code_sha256_prefix":"63e23d37f1f070dd","entry":"NeuralDataTransformerTeacher","repo":"dddavid4real/BLEND","repo_kind":"official","path":"src/model.py","file_url":"https://github.com/dddavid4real/BLEND/blob/HEAD/src/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"63e23d37f1f070dd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}