{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/covariant-spatio-temporal-receptive-fields","title":"Covariant spatio-temporal receptive fields for spiking neural networks","arxiv_id":"2405.00318","date":"2024-05-01","proceeding":null,"authors":["Jens Egholm Pedersen","Jörg Conradt","Tony Lindeberg"],"abstract":"Biological nervous systems constitute important sources of inspiration towards computers that are faster, cheaper, and more energy efficient. Neuromorphic disciplines view the brain as a coevolved system, simultaneously optimizing the hardware and the algorithms running on it. There are clear efficiency gains when bringing the computations into a physical substrate, but we presently lack theories to guide efficient implementations. Here, we present a principled computational model for neuromorphic systems in terms of spatio-temporal receptive fields, based on affine Gaussian kernels over space and leaky-integrator and leaky integrate-and-fire models over time. Our theory is provably covariant to spatial affine and temporal scaling transformations, and with close similarities to the visual processing in mammalian brains. We use these spatio-temporal receptive fields as a prior in an event-based vision task, and show that this improves the training of spiking networks, which otherwise is known as problematic for event-based vision. This work combines efforts within scale-space theory and computational neuroscience to identify theoretically well-founded ways to process spatio-temporal signals in neuromorphic systems. Our contributions are immediately relevant for signal processing and event-based vision, and can be extended to other processing tasks over space and time, such as memory and control.","url_abs":"https://arxiv.org/abs/2405.00318v3","url_pdf":"https://arxiv.org/pdf/2405.00318v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"covariant-spatio-temporal-receptive-fields","repo_url":"https://github.com/jegp/nrf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"event-based-vision","task_name":"Event-based vision"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2405.00318","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.00318"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jegp/nrf","reach":{"status":"ok","spdx":"GPL-3.0"}}],"summary":{"ran":5,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"5ce19bb8d6bb516a","entry":"events_to_frames","repo":"jegp/nrf","repo_kind":"official","path":"visualization.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/visualization.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"5ce19bb8d6bb516a"}},{"code_sha256_prefix":"455ed4d63d2e9980","entry":"int_or_str","repo":"jegp/nrf","repo_kind":"official","path":"learn_shapes.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/learn_shapes.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"455ed4d63d2e9980"}},{"code_sha256_prefix":"0b7efdea8cf003aa","entry":"make_gauss","repo":"jegp/nrf","repo_kind":"official","path":"loss.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"0b7efdea8cf003aa"}},{"code_sha256_prefix":"776142001d456942","entry":"normalized_linspace","repo":"jegp/nrf","repo_kind":"official","path":"loss.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"776142001d456942"}},{"code_sha256_prefix":"ac06044139eafe30","entry":"standardize_kernels","repo":"jegp/nrf","repo_kind":"official","path":"visualization.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/visualization.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"ac06044139eafe30"}},{"code_sha256_prefix":"f863845aedc9e3e2","entry":"normal_pdf","repo":"jegp/nrf","repo_kind":"official","path":"loss.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"f863845aedc9e3e2"}},{"code_sha256_prefix":"1f958be25cb717a4","entry":"rearrange_kernels","repo":"jegp/nrf","repo_kind":"official","path":"visualization.py","file_url":"https://github.com/jegp/nrf/blob/HEAD/visualization.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"1f958be25cb717a4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}