{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/spike-driven-transformer-v2-meta-spiking","title":"Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips","arxiv_id":"2404.03663","date":"2024-02-15","proceeding":null,"authors":["Man Yao","Jiakui Hu","Tianxiang Hu","Yifan Xu","Zhaokun Zhou","Yonghong Tian","Bo Xu","Guoqi Li"],"abstract":"Neuromorphic computing, which exploits Spiking Neural Networks (SNNs) on neuromorphic chips, is a promising energy-efficient alternative to traditional AI. CNN-based SNNs are the current mainstream of neuromorphic computing. By contrast, no neuromorphic chips are designed especially for Transformer-based SNNs, which have just emerged, and their performance is only on par with CNN-based SNNs, offering no distinct advantage. In this work, we propose a general Transformer-based SNN architecture, termed as ``Meta-SpikeFormer\", whose goals are: 1) Lower-power, supports the spike-driven paradigm that there is only sparse addition in the network; 2) Versatility, handles various vision tasks; 3) High-performance, shows overwhelming performance advantages over CNN-based SNNs; 4) Meta-architecture, provides inspiration for future next-generation Transformer-based neuromorphic chip designs. Specifically, we extend the Spike-driven Transformer in \\citet{yao2023spike} into a meta architecture, and explore the impact of structure, spike-driven self-attention, and skip connection on its performance. On ImageNet-1K, Meta-SpikeFormer achieves 80.0\\% top-1 accuracy (55M), surpassing the current state-of-the-art (SOTA) SNN baselines (66M) by 3.7\\%. This is the first direct training SNN backbone that can simultaneously supports classification, detection, and segmentation, obtaining SOTA results in SNNs. Finally, we discuss the inspiration of the meta SNN architecture for neuromorphic chip design. Source code and models are available at \\url{https://github.com/BICLab/Spike-Driven-Transformer-V2}.","url_abs":"https://arxiv.org/abs/2404.03663v1","url_pdf":"https://arxiv.org/pdf/2404.03663v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"spike-driven-transformer-v2-meta-spiking","repo_url":"https://github.com/biclab/spike-driven-transformer-v2","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"snn","method_name":"SNN"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2404.03663","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.03663"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/biclab/spike-driven-transformer-v2","reach":{"status":"ok"}}],"summary":{"ran_fixture":1,"ran_honours":1,"ran":7,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"b47790190bfa0514","entry":"accuracy","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/misc.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/misc.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b47790190bfa0514"}},{"code_sha256_prefix":"bd3578806ecf5ac2","entry":"adjust_learning_rate","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/lr_sched.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/lr_sched.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bd3578806ecf5ac2"}},{"code_sha256_prefix":"3dc19396537db789","entry":"all_reduce_mean","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/misc.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/misc.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3dc19396537db789"}},{"code_sha256_prefix":"27f8c4c706fd43ec","entry":"build_dataset","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/datasets.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/datasets.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"27f8c4c706fd43ec"}},{"code_sha256_prefix":"800cebf161a8aa26","entry":"build_transform","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/datasets.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/datasets.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"800cebf161a8aa26"}},{"code_sha256_prefix":"89edf5372214b57d","entry":"get_layer_id_for_vit","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/lr_decay.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/lr_decay.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89edf5372214b57d"}},{"code_sha256_prefix":"4dc83c19abd8e708","entry":"get_layer_id_for_vit","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/lr_decay_spikformer.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/lr_decay_spikformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4dc83c19abd8e708"}},{"code_sha256_prefix":"8baf25cef41cba16","entry":"param_groups_lrd","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/lr_decay.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/lr_decay.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8baf25cef41cba16"}},{"code_sha256_prefix":"e342f0fada7f4f1e","entry":"param_groups_lrd","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/lr_decay_spikformer.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/lr_decay_spikformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e342f0fada7f4f1e"}},{"code_sha256_prefix":"ba1356e8ceb654d2","entry":"get_grad_norm_","repo":"biclab/spike-driven-transformer-v2","repo_kind":"official","path":"classification/util/misc.py","file_url":"https://github.com/biclab/spike-driven-transformer-v2/blob/HEAD/classification/util/misc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ba1356e8ceb654d2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}