{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/event-based-synthetic-aperture-imaging","title":"Event-based Synthetic Aperture Imaging with a Hybrid Network","arxiv_id":"2103.02376","date":"2021-03-03","proceeding":"CVPR 2021 1","authors":["Xiang Zhang","Wei Liao","Lei Yu","Wen Yang","Gui-Song Xia"],"abstract":"Synthetic aperture imaging (SAI) is able to achieve the see through effect by blurring out the off-focus foreground occlusions and reconstructing the in-focus occluded targets from multi-view images. However, very dense occlusions and extreme lighting conditions may bring significant disturbances to the SAI based on conventional frame-based cameras, leading to performance degeneration. To address these problems, we propose a novel SAI system based on the event camera which can produce asynchronous events with extremely low latency and high dynamic range. Thus, it can eliminate the interference of dense occlusions by measuring with almost continuous views, and simultaneously tackle the over/under exposure problems. To reconstruct the occluded targets, we propose a hybrid encoder-decoder network composed of spiking neural networks (SNNs) and convolutional neural networks (CNNs). In the hybrid network, the spatio-temporal information of the collected events is first encoded by SNN layers, and then transformed to the visual image of the occluded targets by a style-transfer CNN decoder. Through experiments, the proposed method shows remarkable performance in dealing with very dense occlusions and extreme lighting conditions, and high quality visual images can be reconstructed using pure event data.","url_abs":"https://arxiv.org/abs/2103.02376v3","url_pdf":"https://arxiv.org/pdf/2103.02376v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"event-based-synthetic-aperture-imaging","repo_url":"https://github.com/dvs-whu/E-SAI","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"style-transfer","task_name":"Style Transfer"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.02376","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.02376"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dvs-whu/E-SAI","reach":null}],"summary":{"ran":4,"ran_draft_wrong":3,"unverified":2},"by_repo_kind":{"official":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cf794d49d49f9ebe","entry":"ActFun","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf794d49d49f9ebe"}},{"code_sha256_prefix":"695cdd940a3e5a2e","entry":"Identity","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"695cdd940a3e5a2e"}},{"code_sha256_prefix":"07fc7315a1cfc4c6","entry":"ResnetBlock","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"07fc7315a1cfc4c6"}},{"code_sha256_prefix":"147fbb3c65329aec","entry":"ResnetGenerator","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"147fbb3c65329aec"}},{"code_sha256_prefix":"92ed6c48a593a6c5","entry":"get_norm_layer","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"92ed6c48a593a6c5"}},{"code_sha256_prefix":"8dae8fea47c19e0f","entry":"init_net","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8dae8fea47c19e0f"}},{"code_sha256_prefix":"fc04bbce50ccf4c9","entry":"mem_update","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc04bbce50ccf4c9"}},{"code_sha256_prefix":"f9b79e9368142e86","entry":"HybridNet","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9b79e9368142e86"}},{"code_sha256_prefix":"3a87bf224d544149","entry":"define_Res","repo":"dvs-whu/E-SAI","repo_kind":"official","path":"codes/Networks/Hybrid.py","file_url":"https://github.com/dvs-whu/E-SAI/blob/HEAD/codes/Networks/Hybrid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a87bf224d544149"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}