{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/evdistill-asynchronous-events-to-end-task-1","title":"EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation","arxiv_id":"2111.12341","date":"2021-11-24","proceeding":"CVPR 2021 1","authors":["Lin Wang","Yujeong Chae","Sung-Hoon Yoon","Tae-Kyun Kim","Kuk-Jin Yoon"],"abstract":"Event cameras sense per-pixel intensity changes and produce asynchronous event streams with high dynamic range and less motion blur, showing advantages over conventional cameras. A hurdle of training event-based models is the lack of large qualitative labeled data. Prior works learning end-tasks mostly rely on labeled or pseudo-labeled datasets obtained from the active pixel sensor (APS) frames; however, such datasets' quality is far from rivaling those based on the canonical images. In this paper, we propose a novel approach, called \\textbf{EvDistill}, to learn a student network on the unlabeled and unpaired event data (target modality) via knowledge distillation (KD) from a teacher network trained with large-scale, labeled image data (source modality). To enable KD across the unpaired modalities, we first propose a bidirectional modality reconstruction (BMR) module to bridge both modalities and simultaneously exploit them to distill knowledge via the crafted pairs, causing no extra computation in the inference. The BMR is improved by the end-tasks and KD losses in an end-to-end manner. Second, we leverage the structural similarities of both modalities and adapt the knowledge by matching their distributions. Moreover, as most prior feature KD methods are uni-modality and less applicable to our problem, we propose to leverage an affinity graph KD loss to boost the distillation. Our extensive experiments on semantic segmentation and object recognition demonstrate that EvDistill achieves significantly better results than the prior works and KD with only events and APS frames.","url_abs":"https://arxiv.org/abs/2111.12341v1","url_pdf":"https://arxiv.org/pdf/2111.12341v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"evdistill-asynchronous-events-to-end-task-1","repo_url":"https://github.com/addisonwang2013/evdistill","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"event-based-object-segmentation","task_name":"Event-based Object Segmentation"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"object-recognition","task_name":"Object Recognition"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/event-based-object-segmentation-on-mvsec-seg","task":"Event-based Object Segmentation","dataset":"MVSEC-SEG","model":"Evdistill","rank_in_archive_order":7,"of":8,"metrics":{"mIoU":"0.29"},"uses_additional_data":false},{"leaderboard":"/sota/event-based-object-segmentation-on-rgbe-seg","task":"Event-based Object Segmentation","dataset":"RGBE-SEG","model":"Evdistill","rank_in_archive_order":7,"of":8,"metrics":{"mIoU":"0.27"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2111.12341","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.12341"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/addisonwang2013/evdistill","reach":null}],"summary":{"ran":6,"ran_draft_wrong":4,"unverified":7},"by_repo_kind":{"official":{"samples":17,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"3a07013be7ddb70a","entry":"EDSRConv","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3a07013be7ddb70a"}},{"code_sha256_prefix":"9e8c636cac1d847f","entry":"FutureResult","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e8c636cac1d847f"}},{"code_sha256_prefix":"93f1be24e0653bc8","entry":"SyncMaster","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"93f1be24e0653bc8"}},{"code_sha256_prefix":"e6f91e80712a76dd","entry":"SynchronizedBatchNorm2d","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e6f91e80712a76dd"}},{"code_sha256_prefix":"618ccc4e9e5629b2","entry":"Upsample","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"618ccc4e9e5629b2"}},{"code_sha256_prefix":"9f557ce8389a603f","entry":"_SynchronizedBatchNorm","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9f557ce8389a603f"}},{"code_sha256_prefix":"ef8cd9ec7017137d","entry":"build_aspp","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef8cd9ec7017137d"}},{"code_sha256_prefix":"8157861ceb8eb470","entry":"build_backbone","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8157861ceb8eb470"}},{"code_sha256_prefix":"23ce2fc66128ad4c","entry":"build_decoder","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"23ce2fc66128ad4c"}},{"code_sha256_prefix":"5e5f8123e17483ef","entry":"build_im_recon_decoder","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e5f8123e17483ef"}},{"code_sha256_prefix":"fced7a51f0af7316","entry":"ASPP","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fced7a51f0af7316"}},{"code_sha256_prefix":"89524076ef47e188","entry":"ASPP_Nodropout","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89524076ef47e188"}},{"code_sha256_prefix":"f5402b45ac78ab62","entry":"Decoder","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f5402b45ac78ab62"}},{"code_sha256_prefix":"6dad7760a37b19c3","entry":"Decoder_DTL","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6dad7760a37b19c3"}},{"code_sha256_prefix":"d12c50019a4b5875","entry":"Decoder_Nodropout","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d12c50019a4b5875"}},{"code_sha256_prefix":"e2b82e4055074f54","entry":"DeepLab_Dual_V3","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e2b82e4055074f54"}},{"code_sha256_prefix":"5e90ce39dc46a1c4","entry":"_ASPPModule","repo":"addisonwang2013/evdistill","repo_kind":"official","path":"modeling/deeplab.py","file_url":"https://github.com/addisonwang2013/evdistill/blob/HEAD/modeling/deeplab.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e90ce39dc46a1c4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}