{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/temporal-event-stereo-via-joint-learning-with","title":"Temporal Event Stereo via Joint Learning with Stereoscopic Flow","arxiv_id":"2407.10831","date":"2024-07-15","proceeding":null,"authors":["Hoonhee Cho","Jae-Young Kang","Kuk-Jin Yoon"],"abstract":"Event cameras are dynamic vision sensors inspired by the biological retina, characterized by their high dynamic range, high temporal resolution, and low power consumption. These features make them capable of perceiving 3D environments even in extreme conditions. Event data is continuous across the time dimension, which allows a detailed description of each pixel's movements. To fully utilize the temporally dense and continuous nature of event cameras, we propose a novel temporal event stereo, a framework that continuously uses information from previous time steps. This is accomplished through the simultaneous training of an event stereo matching network alongside stereoscopic flow, a new concept that captures all pixel movements from stereo cameras. Since obtaining ground truth for optical flow during training is challenging, we propose a method that uses only disparity maps to train the stereoscopic flow. The performance of event-based stereo matching is enhanced by temporally aggregating information using the flows. We have achieved state-of-the-art performance on the MVSEC and the DSEC datasets. The method is computationally efficient, as it stacks previous information in a cascading manner. The code is available at https://github.com/mickeykang16/TemporalEventStereo.","url_abs":"https://arxiv.org/abs/2407.10831v1","url_pdf":"https://arxiv.org/pdf/2407.10831v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"temporal-event-stereo-via-joint-learning-with","repo_url":"https://github.com/mickeykang16/temporaleventstereo","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"optical-flow-estimation","task_name":"Optical Flow Estimation"},{"task_slug":"stereo-matching-1","task_name":"Stereo Matching"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2407.10831","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.10831"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mickeykang16/temporaleventstereo","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/mickeykang16/TemporalEventStereo","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_draft_wrong":2,"unverified":4},"by_repo_kind":{"official":{"samples":12,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"d2312799ba138ae1","entry":"IFBlock","repo":"mickeykang16/TemporalEventStereo","repo_kind":"official","path":"models/model_large.py","file_url":"https://github.com/mickeykang16/TemporalEventStereo/blob/HEAD/models/model_large.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d2312799ba138ae1"}},{"code_sha256_prefix":"3b611cb2cd13aa7d","entry":"conv","repo":"mickeykang16/TemporalEventStereo","repo_kind":"official","path":"models/model_large.py","file_url":"https://github.com/mickeykang16/TemporalEventStereo/blob/HEAD/models/model_large.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b611cb2cd13aa7d"}},{"code_sha256_prefix":"15ab3c76823aef7e","entry":"convbn","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"models/submodule.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/models/submodule.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"15ab3c76823aef7e"}},{"code_sha256_prefix":"46674adf87c5459d","entry":"convbn_3d","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"models/submodule.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/models/submodule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"46674adf87c5459d"}},{"code_sha256_prefix":"f4e988691f968d49","entry":"crop","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"dataloader/common.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/dataloader/common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f4e988691f968d49"}},{"code_sha256_prefix":"5ab284f1473d2ba8","entry":"deconv","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"models/model_large.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/models/model_large.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5ab284f1473d2ba8"}},{"code_sha256_prefix":"2a387945496b5851","entry":"events_to_voxel_grid","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"pre-processing/voxel_generate_all.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/pre-processing/voxel_generate_all.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2a387945496b5851"}},{"code_sha256_prefix":"be96b411d1f4810c","entry":"rectify_events","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"pre-processing/raw_event_parsing.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/pre-processing/raw_event_parsing.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"be96b411d1f4810c"}},{"code_sha256_prefix":"dcebed3763084f9c","entry":"TESNet","repo":"mickeykang16/TemporalEventStereo","repo_kind":"official","path":"models/model_large.py","file_url":"https://github.com/mickeykang16/TemporalEventStereo/blob/HEAD/models/model_large.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dcebed3763084f9c"}},{"code_sha256_prefix":"40c536b366203366","entry":"crop_disp","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"dataloader/common.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/dataloader/common.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"40c536b366203366"}},{"code_sha256_prefix":"9e0213a8038f4aa0","entry":"crop_event","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"dataloader/common.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/dataloader/common.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e0213a8038f4aa0"}},{"code_sha256_prefix":"adff203ed32cd918","entry":"get_datasets","repo":"mickeykang16/temporaleventstereo","repo_kind":"official","path":"dataloader/dsceDataset.py","file_url":"https://github.com/mickeykang16/temporaleventstereo/blob/HEAD/dataloader/dsceDataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"adff203ed32cd918"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}