{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/efficient-distillation-of-deep-spiking-neural","title":"Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment","arxiv_id":"2501.15925","date":"2025-01-27","proceeding":null,"authors":["Chengting Yu","Xiaochen Zhao","Lei Liu","Shu Yang","Gaoang Wang","Erping Li","Aili Wang"],"abstract":"Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from accuracy degradation compared to ANNs and face deployment challenges due to fixed inference timesteps, which require retraining for adjustments, limiting operational flexibility. To address these issues, our work considers the spatio-temporal property inherent in SNNs, and proposes a novel distillation framework for deep SNNs that optimizes performance across full-range timesteps without specific retraining, enhancing both efficacy and deployment adaptability. We provide both theoretical analysis and empirical validations to illustrate that training guarantees the convergence of all implicit models across full-range timesteps. Experimental results on CIFAR-10, CIFAR-100, CIFAR10-DVS, and ImageNet demonstrate state-of-the-art performance among distillation-based SNNs training methods. Our code is available at https://github.com/Intelli-Chip-Lab/snn\\_temporal\\_decoupling\\_distillation.","url_abs":"https://arxiv.org/abs/2501.15925v2","url_pdf":"https://arxiv.org/pdf/2501.15925v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"efficient-distillation-of-deep-spiking-neural","repo_url":"https://github.com/Intelli-Chip-Lab/snn_temporal_decoupling_distillation","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2501.15925","atlas_url":"https://app.syntology.ai/?focus=2501.15925","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2501.15925"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Intelli-Chip-Lab/snn","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Intelli-Chip-Lab/snn_temporal_decoupling_distillation","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"556c2f231c1c30e9","entry":"kd_loss","repo":"intelli-chip-lab/snn_temporal_decoupling_distillation","repo_kind":"official","path":"model/layer.py","file_url":"https://github.com/intelli-chip-lab/snn_temporal_decoupling_distillation/blob/HEAD/model/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"556c2f231c1c30e9"}},{"code_sha256_prefix":"f823c61767cb0e17","entry":"cal_loss","repo":"intelli-chip-lab/snn_temporal_decoupling_distillation","repo_kind":"official","path":"model/layer.py","file_url":"https://github.com/intelli-chip-lab/snn_temporal_decoupling_distillation/blob/HEAD/model/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f823c61767cb0e17"}},{"code_sha256_prefix":"99f0b1d596a61201","entry":"make_teacher","repo":"intelli-chip-lab/snn_temporal_decoupling_distillation","repo_kind":"official","path":"model/layer.py","file_url":"https://github.com/intelli-chip-lab/snn_temporal_decoupling_distillation/blob/HEAD/model/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"99f0b1d596a61201"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}