{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/eventrpg-event-data-augmentation-with","title":"EventRPG: Event Data Augmentation with Relevance Propagation Guidance","arxiv_id":"2403.09274","date":"2024-03-14","proceeding":null,"authors":["Mingyuan Sun","Donghao Zhang","ZongYuan Ge","Jiaxu Wang","Jia Li","Zheng Fang","Renjing Xu"],"abstract":"Event camera, a novel bio-inspired vision sensor, has drawn a lot of attention for its low latency, low power consumption, and high dynamic range. Currently, overfitting remains a critical problem in event-based classification tasks for Spiking Neural Network (SNN) due to its relatively weak spatial representation capability. Data augmentation is a simple but efficient method to alleviate overfitting and improve the generalization ability of neural networks, and saliency-based augmentation methods are proven to be effective in the image processing field. However, there is no approach available for extracting saliency maps from SNNs. Therefore, for the first time, we present Spiking Layer-Time-wise Relevance Propagation rule (SLTRP) and Spiking Layer-wise Relevance Propagation rule (SLRP) in order for SNN to generate stable and accurate CAMs and saliency maps. Based on this, we propose EventRPG, which leverages relevance propagation on the spiking neural network for more efficient augmentation. Our proposed method has been evaluated on several SNN structures, achieving state-of-the-art performance in object recognition tasks including N-Caltech101, CIFAR10-DVS, with accuracies of 85.62% and 85.55%, as well as action recognition task SL-Animals with an accuracy of 91.59%. Our code is available at https://github.com/myuansun/EventRPG.","url_abs":"https://arxiv.org/abs/2403.09274v1","url_pdf":"https://arxiv.org/pdf/2403.09274v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"eventrpg-event-data-augmentation-with","repo_url":"https://github.com/myuansun/eventrpg","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"object-recognition","task_name":"Object Recognition"}],"methods":[{"method_slug":"snn","method_name":"SNN"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-on-dvs128-gesture","task":"Action Recognition","dataset":"DVS128 Gesture","model":"SEW-Resnet18","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy (% )":"96.53"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-on-sl-animals","task":"Action Recognition","dataset":"SL-Animals","model":"SEW-Resnet18 (3sets)","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy (% )":"93.75"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-on-sl-animals","task":"Action Recognition","dataset":"SL-Animals","model":"SEW-Resnet18 (4sets)","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy (% )":"91.59"},"uses_additional_data":false},{"leaderboard":"/sota/object-recognition-on-cifar10-dvs","task":"Object Recognition","dataset":"CIFAR10-DVS","model":"Spike-VGG11","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy (% )":"85.55"},"uses_additional_data":false},{"leaderboard":"/sota/object-recognition-on-n-cars","task":"Object Recognition","dataset":"N-CARS","model":"Spike-VGG11","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy (% )":"96.00"},"uses_additional_data":false},{"leaderboard":"/sota/object-recognition-on-n-caltech-101","task":"Object Recognition","dataset":"N-Caltech 101","model":"Spike-VGG11","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy (% )":"85.62"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.09274","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.09274"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/myuansun/EventRPG","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/myuansun/eventrpg","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"ran_fixture":2,"ran_honours":1,"unverified":11},"by_repo_kind":{"official":{"samples":16,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"127b8f6110c5249c","entry":"TET_loss","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_utils/functions.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_utils/functions.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"127b8f6110c5249c"}},{"code_sha256_prefix":"530a364d830eeefc","entry":"mid_normalize","repo":"myuansun/eventrpg","repo_kind":"official","path":"utils/RelCAM.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/utils/RelCAM.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"530a364d830eeefc"}},{"code_sha256_prefix":"e22727da062c7d52","entry":"mixup_criterion_raw_events","repo":"myuansun/EventRPG","repo_kind":"official","path":"train_distributed.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/train_distributed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e22727da062c7d52"}},{"code_sha256_prefix":"1b03542f209fada4","entry":"percentile","repo":"myuansun/eventrpg","repo_kind":"official","path":"utils/RelCAM.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/utils/RelCAM.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b03542f209fada4"}},{"code_sha256_prefix":"251e368f5f9b12f5","entry":"safe_divide","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_utils/layers.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_utils/layers.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"251e368f5f9b12f5"}},{"code_sha256_prefix":"67cfeaf9efec718e","entry":"RelProp","repo":"myuansun/eventrpg","repo_kind":"official","path":"snn_utils/layers.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/snn_utils/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"67cfeaf9efec718e"}},{"code_sha256_prefix":"747f3bb47629c67a","entry":"conv1x1","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_utils/sew_resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_utils/sew_resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"747f3bb47629c67a"}},{"code_sha256_prefix":"19a22f01cee3edae","entry":"conv1x1","repo":"myuansun/EventRPG","repo_kind":"official","path":"utils/resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/utils/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19a22f01cee3edae"}},{"code_sha256_prefix":"e9e146fe9b081dfa","entry":"conv3x3","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_utils/sew_resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_utils/sew_resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e9e146fe9b081dfa"}},{"code_sha256_prefix":"c930c4c4b347fdeb","entry":"conv3x3","repo":"myuansun/EventRPG","repo_kind":"official","path":"utils/resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/utils/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c930c4c4b347fdeb"}},{"code_sha256_prefix":"981e67821bf26084","entry":"mixup_criterion_raw_events","repo":"myuansun/eventrpg","repo_kind":"official","path":"snn_train.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/snn_train.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"981e67821bf26084"}},{"code_sha256_prefix":"f4154dada5bcd3af","entry":"reduce_mean","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_train_distributed.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_train_distributed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f4154dada5bcd3af"}},{"code_sha256_prefix":"f15b5608e35440eb","entry":"resnet18","repo":"myuansun/EventRPG","repo_kind":"official","path":"utils/resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/utils/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f15b5608e35440eb"}},{"code_sha256_prefix":"4682daea820db90c","entry":"sew_function","repo":"myuansun/EventRPG","repo_kind":"official","path":"snn_utils/sew_resnet.py","file_url":"https://github.com/myuansun/EventRPG/blob/HEAD/snn_utils/sew_resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4682daea820db90c"}},{"code_sha256_prefix":"19e247af0b21c75a","entry":"slrp_forward_hook","repo":"myuansun/eventrpg","repo_kind":"official","path":"snn_utils/layers.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/snn_utils/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19e247af0b21c75a"}},{"code_sha256_prefix":"171f1ac017872454","entry":"sltrp_forward_hook","repo":"myuansun/eventrpg","repo_kind":"official","path":"snn_utils/layers.py","file_url":"https://github.com/myuansun/eventrpg/blob/HEAD/snn_utils/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"171f1ac017872454"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}