{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/efficient-event-stream-super-resolution-with","title":"Efficient Event Stream Super-Resolution with Recursive Multi-Branch Fusion","arxiv_id":"2406.19640","date":"2024-06-28","proceeding":null,"authors":["Quanmin Liang","Zhilin Huang","Xiawu Zheng","Feidiao Yang","Jun Peng","Kai Huang","Yonghong Tian"],"abstract":"Current Event Stream Super-Resolution (ESR) methods overlook the redundant and complementary information present in positive and negative events within the event stream, employing a direct mixing approach for super-resolution, which may lead to detail loss and inefficiency. To address these issues, we propose an efficient Recursive Multi-Branch Information Fusion Network (RMFNet) that separates positive and negative events for complementary information extraction, followed by mutual supplementation and refinement. Particularly, we introduce Feature Fusion Modules (FFM) and Feature Exchange Modules (FEM). FFM is designed for the fusion of contextual information within neighboring event streams, leveraging the coupling relationship between positive and negative events to alleviate the misleading of noises in the respective branches. FEM efficiently promotes the fusion and exchange of information between positive and negative branches, enabling superior local information enhancement and global information complementation. Experimental results demonstrate that our approach achieves over 17% and 31% improvement on synthetic and real datasets, accompanied by a 2.3X acceleration. Furthermore, we evaluate our method on two downstream event-driven applications, \\emph{i.e.}, object recognition and video reconstruction, achieving remarkable results that outperform existing methods. Our code and Supplementary Material are available at https://github.com/Lqm26/RMFNet.","url_abs":"https://arxiv.org/abs/2406.19640v1","url_pdf":"https://arxiv.org/pdf/2406.19640v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"efficient-event-stream-super-resolution-with","repo_url":"https://github.com/lqm26/rmfnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"object-recognition","task_name":"Object Recognition"},{"task_slug":"super-resolution","task_name":"Super-Resolution"},{"task_slug":"video-reconstruction","task_name":"Video Reconstruction"}],"methods":[{"method_slug":"fem","method_name":"FEM"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.19640","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.19640"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Lqm26/RMFNet","reach":{"status":"ok"}}],"summary":{"ran":3,"ran_draft_wrong":2},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"fdea4c767e9ccb2a","entry":"binary_search_torch_tensor","repo":"Lqm26/RMFNet","repo_kind":"official","path":"dataloader/encodings.py","file_url":"https://github.com/Lqm26/RMFNet/blob/HEAD/dataloader/encodings.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fdea4c767e9ccb2a"}},{"code_sha256_prefix":"47b781b89bb2f3f0","entry":"events_to_image_torch","repo":"Lqm26/RMFNet","repo_kind":"official","path":"dataloader/encodings.py","file_url":"https://github.com/Lqm26/RMFNet/blob/HEAD/dataloader/encodings.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"47b781b89bb2f3f0"}},{"code_sha256_prefix":"dca2a09bd568df1b","entry":"events_to_voxel_torch","repo":"Lqm26/RMFNet","repo_kind":"official","path":"dataloader/encodings.py","file_url":"https://github.com/Lqm26/RMFNet/blob/HEAD/dataloader/encodings.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dca2a09bd568df1b"}},{"code_sha256_prefix":"c04a23de0531da4a","entry":"make_layer","repo":"Lqm26/RMFNet","repo_kind":"official","path":"models/submodules.py","file_url":"https://github.com/Lqm26/RMFNet/blob/HEAD/models/submodules.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c04a23de0531da4a"}},{"code_sha256_prefix":"3739d13f4a583c2c","entry":"pixel_unshuffle","repo":"Lqm26/RMFNet","repo_kind":"official","path":"models/submodules.py","file_url":"https://github.com/Lqm26/RMFNet/blob/HEAD/models/submodules.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3739d13f4a583c2c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}