{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-14252","title":"Not All Timesteps Matter Equally: Selective Alignment Knowledge Distillation for Spiking Neural Networks","arxiv_id":"2605.14252","date":"2026-05-14","proceeding":null,"authors":["Kai Sun","Peibo Duan","Yongsheng Huang","Guowei Zhang","Benjamin Smith","Nanxu Gong","Levin Kuhlmann"],"abstract":"Spiking neural networks (SNNs), which are brain-inspired and spike-driven, achieve high energy efficiency. However, a performance gap between SNNs and artificial neural networks (ANNs) still remains. Knowledge distillation (KD) is commonly adopted to improve SNN performance, but existing methods typically enforce uniform alignment across all timesteps, either from a teacher network or through inter-temporal self-distillation, implicitly assuming that per-timestep predictions should be treated equally. In practice, SNN predictions vary and evolve over time, and intermediate timesteps need not all be individually correct even when the final aggregated output is correct. Under such conditions, effective distillation should not force every timestep toward the same supervision target, but instead provide corrective guidance to erroneous timesteps while preserving useful temporal dynamics. To address this issue, we propose Selective Alignment Knowledge Distillation (SeAl-KD), which selectively aligns class-level and temporal knowledge by equalizing competing logits at erroneous timesteps and reweighting temporal alignment based on confidence and inter-timestep similarity. Extensive experiments on static image and neuromorphic event-based datasets demonstrate consistent improvements over existing distillation methods. The code is available at https://github.com/KaiSUN1/SeAl","url_abs":"https://arxiv.org/abs/2605.14252","url_pdf":"https://arxiv.org/pdf/2605.14252","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.14252","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.14252"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/KaiSUN1/SeAl","reach":null}],"summary":{"ran_draft_wrong":4,"ran_fixture":1,"ran":10,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":19,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":20,"samples":[{"code_sha256_prefix":"556c2f231c1c30e9","entry":"kd_loss","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/layer.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/layer.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"556c2f231c1c30e9"}},{"code_sha256_prefix":"eab4f74c38cc3c8f","entry":"accuracy","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/misc.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/misc.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"eab4f74c38cc3c8f"}},{"code_sha256_prefix":"6a9087bf92f0597a","entry":"binary_entropy_loss","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/layer.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6a9087bf92f0597a"}},{"code_sha256_prefix":"f823c61767cb0e17","entry":"cal_loss","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"f823c61767cb0e17"}},{"code_sha256_prefix":"2a80220dabcb742a","entry":"conv1x1","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/ResNet_ANN.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/ResNet_ANN.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2a80220dabcb742a"}},{"code_sha256_prefix":"b7e4b36a17dd3781","entry":"conv1x1","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/preact_resnet.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/preact_resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b7e4b36a17dd3781"}},{"code_sha256_prefix":"600ff2c45e0de056","entry":"conv3x3","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/ResNet_ANN.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/ResNet_ANN.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"600ff2c45e0de056"}},{"code_sha256_prefix":"ba22fada8b666dd3","entry":"conv3x3","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/preact_resnet.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/preact_resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ba22fada8b666dd3"}},{"code_sha256_prefix":"3879c6422f278486","entry":"direction_loss","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/layer.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3879c6422f278486"}},{"code_sha256_prefix":"2c92cec199cf12cd","entry":"get_mean_and_std","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/misc.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/misc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c92cec199cf12cd"}},{"code_sha256_prefix":"fcccc187a7be3a11","entry":"get_model_name","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/util.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fcccc187a7be3a11"}},{"code_sha256_prefix":"82506bf89d625519","entry":"index_classes","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/data.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"82506bf89d625519"}},{"code_sha256_prefix":"e5058f3641a60c57","entry":"random_spilt","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/data.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e5058f3641a60c57"}},{"code_sha256_prefix":"d7690d8a36f26fd4","entry":"setup_seed","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/util.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d7690d8a36f26fd4"}},{"code_sha256_prefix":"2251c650b9c59b49","entry":"warp_decay","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/util.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2251c650b9c59b49"}},{"code_sha256_prefix":"81e49577210170fe","entry":"GetCifar10","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"experiment/dvs/process.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/experiment/dvs/process.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"81e49577210170fe"}},{"code_sha256_prefix":"015dba96f0e06ba1","entry":"GetCifar100","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"experiment/dvs/process.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/experiment/dvs/process.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"015dba96f0e06ba1"}},{"code_sha256_prefix":"f4a0da0d87c4087c","entry":"GetImageNet","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"experiment/dvs/process.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/experiment/dvs/process.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f4a0da0d87c4087c"}},{"code_sha256_prefix":"cddb8eda1eb5217a","entry":"conv3x3","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"model/resnet.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/model/resnet.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cddb8eda1eb5217a"}},{"code_sha256_prefix":"0f531dbf66a71c5d","entry":"load_dataset","repo":"KaiSUN1/SeAl","repo_kind":"found_in_text","path":"util/data.py","file_url":"https://github.com/KaiSUN1/SeAl/blob/HEAD/util/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f531dbf66a71c5d"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}