{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/temporally-consistent-stereo-matching","title":"Temporally Consistent Stereo Matching","arxiv_id":"2407.11950","date":"2024-07-16","proceeding":null,"authors":["Jiaxi Zeng","Chengtang Yao","Yuwei Wu","Yunde Jia"],"abstract":"Stereo matching provides depth estimation from binocular images for downstream applications. These applications mostly take video streams as input and require temporally consistent depth maps. However, existing methods mainly focus on the estimation at the single-frame level. This commonly leads to temporally inconsistent results, especially in ill-posed regions. In this paper, we aim to leverage temporal information to improve the temporal consistency, accuracy, and efficiency of stereo matching. To achieve this, we formulate video stereo matching as a process of temporal disparity completion followed by continuous iterative refinements. Specifically, we first project the disparity of the previous timestamp to the current viewpoint, obtaining a semi-dense disparity map. Then, we complete this map through a disparity completion module to obtain a well-initialized disparity map. The state features from the current completion module and from the past refinement are fused together, providing a temporally coherent state for subsequent refinement. Based on this coherent state, we introduce a dual-space refinement module to iteratively refine the initialized result in both disparity and disparity gradient spaces, improving estimations in ill-posed regions. Extensive experiments demonstrate that our method effectively alleviates temporal inconsistency while enhancing both accuracy and efficiency.","url_abs":"https://arxiv.org/abs/2407.11950v1","url_pdf":"https://arxiv.org/pdf/2407.11950v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"temporally-consistent-stereo-matching","repo_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"depth-estimation","task_name":"Depth Estimation"},{"task_slug":"stereo-matching-1","task_name":"Stereo Matching"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2407.11950","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.11950"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"ran":4,"ran_fixture":2,"unverified":3},"by_repo_kind":{"official":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f6b944f50d3f15ae","entry":"count_parameters","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"evaluate_stereo.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/evaluate_stereo.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6b944f50d3f15ae"}},{"code_sha256_prefix":"58077120624c5300","entry":"depth2disp","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/utils/geo_utils.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/utils/geo_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"58077120624c5300"}},{"code_sha256_prefix":"41b5d7f056eb7f26","entry":"disp2depth","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/utils/geo_utils.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/utils/geo_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"41b5d7f056eb7f26"}},{"code_sha256_prefix":"08bedbc0c0447f5d","entry":"interp","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/update.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/update.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08bedbc0c0447f5d"}},{"code_sha256_prefix":"25894ad2a73a8142","entry":"pool2x","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/update.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/update.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25894ad2a73a8142"}},{"code_sha256_prefix":"37cde020fcf1c28c","entry":"readDispBooster","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/utils/frame_utils.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/utils/frame_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"37cde020fcf1c28c"}},{"code_sha256_prefix":"7c3fbc1f552de802","entry":"readPFM","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/utils/frame_utils.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/utils/frame_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7c3fbc1f552de802"}},{"code_sha256_prefix":"771e8ac695af28a9","entry":"pool4x","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/update.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/update.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"771e8ac695af28a9"}},{"code_sha256_prefix":"1662ea0b62b0229c","entry":"readFlow","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"core/utils/frame_utils.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/core/utils/frame_utils.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1662ea0b62b0229c"}},{"code_sha256_prefix":"a43e7cd33696630d","entry":"sequence_loss","repo":"jiaxiZeng/Temporally-Consistent-Stereo-Matching","repo_kind":"official","path":"train_stereo.py","file_url":"https://github.com/jiaxiZeng/Temporally-Consistent-Stereo-Matching/blob/HEAD/train_stereo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a43e7cd33696630d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}