{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/advancing-training-efficiency-of-deep-spiking","title":"Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation","arxiv_id":"2410.11488","date":"2024-10-15","proceeding":null,"authors":["Chengting Yu","Lei Liu","Gaoang Wang","Erping Li","Aili Wang"],"abstract":"Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these findings, we propose rate-based backpropagation, a training strategy specifically designed to exploit rate-based representations to reduce the complexity of BPTT. Our method minimizes reliance on detailed temporal derivatives by focusing on averaged dynamics, streamlining the computational graph to reduce memory and computational demands of SNNs training. We substantiate the rationality of the gradient approximation between BPTT and the proposed method through both theoretical analysis and empirical observations. Comprehensive experiments on CIFAR-10, CIFAR-100, ImageNet, and CIFAR10-DVS validate that our method achieves comparable performance to BPTT counterparts, and surpasses state-of-the-art efficient training techniques. By leveraging the inherent benefits of rate-coding, this work sets the stage for more scalable and efficient SNNs training within resource-constrained environments. Our code is available at https://github.com/Tab-ct/rate-based-backpropagation.","url_abs":"https://arxiv.org/abs/2410.11488v2","url_pdf":"https://arxiv.org/pdf/2410.11488v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"advancing-training-efficiency-of-deep-spiking","repo_url":"https://github.com/tab-ct/rate-based-backpropagation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.11488","atlas_url":"https://app.syntology.ai/?focus=2410.11488","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.11488"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Tab-ct/rate-based-backpropagation","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tab-ct/rate-based-backpropagation","reach":{"status":"ok"}}],"summary":{"ran_fixture":1,"ran":6,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"18badd533b52adb3","entry":"accuracy","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"util/misc.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/util/misc.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"18badd533b52adb3"}},{"code_sha256_prefix":"16f164afee5c1d7a","entry":"bn_forward_hook","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"model/model_setting.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/model/model_setting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"16f164afee5c1d7a"}},{"code_sha256_prefix":"9c2cd210b665d7eb","entry":"calcu_rate","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"model/model_setting.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/model/model_setting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9c2cd210b665d7eb"}},{"code_sha256_prefix":"e9a0d83414c62991","entry":"calcu_spikes_mean_and_var","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"model/model_setting.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/model/model_setting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e9a0d83414c62991"}},{"code_sha256_prefix":"2c6f2c0e6aa70305","entry":"get_model_name","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"util/util.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/util/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c6f2c0e6aa70305"}},{"code_sha256_prefix":"11115e6af2c68333","entry":"load_dataset","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"util/data.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/util/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"11115e6af2c68333"}},{"code_sha256_prefix":"d7690d8a36f26fd4","entry":"setup_seed","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"util/util.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/util/util.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d7690d8a36f26fd4"}},{"code_sha256_prefix":"cddb8eda1eb5217a","entry":"conv3x3","repo":"Tab-ct/rate-based-backpropagation","repo_kind":"official","path":"model/resnet.py","file_url":"https://github.com/Tab-ct/rate-based-backpropagation/blob/HEAD/model/resnet.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cddb8eda1eb5217a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}