{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/training-high-performance-low-latency-spiking","title":"Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation","arxiv_id":"2205.00459","date":"2022-05-01","proceeding":"CVPR 2022 1","authors":["Qingyan Meng","Mingqing Xiao","Shen Yan","Yisen Wang","Zhouchen Lin","Zhi-Quan Luo"],"abstract":"Spiking Neural Network (SNN) is a promising energy-efficient AI model when implemented on neuromorphic hardware. However, it is a challenge to efficiently train SNNs due to their non-differentiability. Most existing methods either suffer from high latency (i.e., long simulation time steps), or cannot achieve as high performance as Artificial Neural Networks (ANNs). In this paper, we propose the Differentiation on Spike Representation (DSR) method, which could achieve high performance that is competitive to ANNs yet with low latency. First, we encode the spike trains into spike representation using (weighted) firing rate coding. Based on the spike representation, we systematically derive that the spiking dynamics with common neural models can be represented as some sub-differentiable mapping. With this viewpoint, our proposed DSR method trains SNNs through gradients of the mapping and avoids the common non-differentiability problem in SNN training. Then we analyze the error when representing the specific mapping with the forward computation of the SNN. To reduce such error, we propose to train the spike threshold in each layer, and to introduce a new hyperparameter for the neural models. With these components, the DSR method can achieve state-of-the-art SNN performance with low latency on both static and neuromorphic datasets, including CIFAR-10, CIFAR-100, ImageNet, and DVS-CIFAR10.","url_abs":"https://arxiv.org/abs/2205.00459v2","url_pdf":"https://arxiv.org/pdf/2205.00459v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"training-high-performance-low-latency-spiking","repo_url":"https://github.com/qymeng94/dsr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.00459","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.00459"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qymeng94/dsr","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/qymeng94/DSR","reach":{"status":"ok"}}],"summary":{"ran":1,"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"ec3b977d0aa35242","entry":"LIFFunction","repo":"qymeng94/DSR","repo_kind":"official","path":"imagenet/neuron.py","file_url":"https://github.com/qymeng94/DSR/blob/HEAD/imagenet/neuron.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ec3b977d0aa35242"}},{"code_sha256_prefix":"4d68a63cc41650d9","entry":"lif_grad","repo":"qymeng94/DSR","repo_kind":"official","path":"imagenet/neuron.py","file_url":"https://github.com/qymeng94/DSR/blob/HEAD/imagenet/neuron.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4d68a63cc41650d9"}},{"code_sha256_prefix":"87c74170924e3caa","entry":"sum_tensor","repo":"qymeng94/DSR","repo_kind":"official","path":"imagenet/neuron.py","file_url":"https://github.com/qymeng94/DSR/blob/HEAD/imagenet/neuron.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"87c74170924e3caa"}},{"code_sha256_prefix":"661427fd6fb1467e","entry":"weight_rate_spikes","repo":"qymeng94/DSR","repo_kind":"official","path":"imagenet/neuron.py","file_url":"https://github.com/qymeng94/DSR/blob/HEAD/imagenet/neuron.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"661427fd6fb1467e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}