{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sufficient-conditions-for-offline-1","title":"Sufficient conditions for offline reactivation in recurrent neural networks","arxiv_id":"2505.17003","date":"2025-05-22","proceeding":"Internation Conference on Learning Representations 2024 1","authors":["Nanda H. Krishna","Colin Bredenberg","Daniel Levenstein","Blake A. Richards","Guillaume Lajoie"],"abstract":"During periods of quiescence, such as sleep, neural activity in many brain circuits resembles that observed during periods of task engagement. However, the precise conditions under which task-optimized networks can autonomously reactivate the same network states responsible for online behavior is poorly understood. In this study, we develop a mathematical framework that outlines sufficient conditions for the emergence of neural reactivation in circuits that encode features of smoothly varying stimuli. We demonstrate mathematically that noisy recurrent networks optimized to track environmental state variables using change-based sensory information naturally develop denoising dynamics, which, in the absence of input, cause the network to revisit state configurations observed during periods of online activity. We validate our findings using numerical experiments on two canonical neuroscience tasks: spatial position estimation based on self-motion cues, and head direction estimation based on angular velocity cues. Overall, our work provides theoretical support for modeling offline reactivation as an emergent consequence of task optimization in noisy neural circuits.","url_abs":"https://arxiv.org/abs/2505.17003v1","url_pdf":"https://arxiv.org/pdf/2505.17003v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sufficient-conditions-for-offline-1","repo_url":"https://github.com/nandahkrishna/RNNReactivation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2505.17003","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2505.17003"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/nandahkrishna/RNNReactivation","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a40a282018beddee","entry":"kde","repo":"nandahkrishna/RNNReactivation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/nandahkrishna/RNNReactivation/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"a40a282018beddee"}},{"code_sha256_prefix":"93d7219bda1beca7","entry":"kl_divergence","repo":"nandahkrishna/RNNReactivation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/nandahkrishna/RNNReactivation/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"93d7219bda1beca7"}},{"code_sha256_prefix":"de64706fdded02bc","entry":"load_analysis_config","repo":"nandahkrishna/RNNReactivation","repo_kind":"official","path":"config.py","file_url":"https://github.com/nandahkrishna/RNNReactivation/blob/HEAD/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"de64706fdded02bc"}},{"code_sha256_prefix":"784d92bfbcb5ef80","entry":"output_variance","repo":"nandahkrishna/RNNReactivation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/nandahkrishna/RNNReactivation/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"784d92bfbcb5ef80"}},{"code_sha256_prefix":"101887090d35ebfd","entry":"von_mises","repo":"nandahkrishna/RNNReactivation","repo_kind":"official","path":"tasks/head_direction.py","file_url":"https://github.com/nandahkrishna/RNNReactivation/blob/HEAD/tasks/head_direction.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"101887090d35ebfd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}