{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/smd-nets-stereo-mixture-density-networks","title":"SMD-Nets: Stereo Mixture Density Networks","arxiv_id":"2104.03866","date":"2021-04-08","proceeding":"CVPR 2021 1","authors":["Fabio Tosi","Yiyi Liao","Carolin Schmitt","Andreas Geiger"],"abstract":"Despite stereo matching accuracy has greatly improved by deep learning in the last few years, recovering sharp boundaries and high-resolution outputs efficiently remains challenging. In this paper, we propose Stereo Mixture Density Networks (SMD-Nets), a simple yet effective learning framework compatible with a wide class of 2D and 3D architectures which ameliorates both issues. Specifically, we exploit bimodal mixture densities as output representation and show that this allows for sharp and precise disparity estimates near discontinuities while explicitly modeling the aleatoric uncertainty inherent in the observations. Moreover, we formulate disparity estimation as a continuous problem in the image domain, allowing our model to query disparities at arbitrary spatial precision. We carry out comprehensive experiments on a new high-resolution and highly realistic synthetic stereo dataset, consisting of stereo pairs at 8Mpx resolution, as well as on real-world stereo datasets. Our experiments demonstrate increased depth accuracy near object boundaries and prediction of ultra high-resolution disparity maps on standard GPUs. We demonstrate the flexibility of our technique by improving the performance of a variety of stereo backbones.","url_abs":"https://arxiv.org/abs/2104.03866v1","url_pdf":"https://arxiv.org/pdf/2104.03866v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"smd-nets-stereo-mixture-density-networks","repo_url":"https://github.com/fabiotosi92/SMD-Nets","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"smd-nets-stereo-mixture-density-networks","repo_url":"https://github.com/Mirmix/ddlmvs","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"disparity-estimation","task_name":"Disparity Estimation"},{"task_slug":"stereo-matching-1","task_name":"Stereo Matching"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2104.03866","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.03866"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Mirmix/ddlmvs","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/fabiotosi92/SMD-Nets","reach":null}],"summary":{"ran":10,"ran_draft_wrong":4,"ran_fixture":1,"unverified":13},"by_repo_kind":{"official":{"samples":14,"ran":5,"repositories":1},"listed":{"samples":14,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"76a27023b936b897","entry":"ConvBnReLU3D","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"76a27023b936b897"}},{"code_sha256_prefix":"92bc6ab66d10346b","entry":"DepthInitialization","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"92bc6ab66d10346b"}},{"code_sha256_prefix":"ee2cc279bdf6169f","entry":"FeatureNet","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee2cc279bdf6169f"}},{"code_sha256_prefix":"fde70f1c0e22a3e9","entry":"FeatureWeightNet","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fde70f1c0e22a3e9"}},{"code_sha256_prefix":"de28fde5fb92de44","entry":"PixelwiseNet","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de28fde5fb92de44"}},{"code_sha256_prefix":"9dc98895fe55dc6b","entry":"Propagation","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9dc98895fe55dc6b"}},{"code_sha256_prefix":"c2896a15e4b9aa7d","entry":"Regressor","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2896a15e4b9aa7d"}},{"code_sha256_prefix":"0e653694acc4e981","entry":"ResNetMultiImageInput","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e653694acc4e981"}},{"code_sha256_prefix":"52e4096f56488419","entry":"SimilarityNet","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52e4096f56488419"}},{"code_sha256_prefix":"a16de707e5586b16","entry":"Sine","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a16de707e5586b16"}},{"code_sha256_prefix":"e8f9986089f1f048","entry":"depth_regression","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8f9986089f1f048"}},{"code_sha256_prefix":"25252e58e3b331de","entry":"depth_weight","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25252e58e3b331de"}},{"code_sha256_prefix":"00b8d4f5fece378f","entry":"differentiable_warping","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00b8d4f5fece378f"}},{"code_sha256_prefix":"eb4a51cd37197a6e","entry":"local_contrast_normalization","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eb4a51cd37197a6e"}},{"code_sha256_prefix":"98f5a5eb6fec0a91","entry":"resnet_multiimage_input","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98f5a5eb6fec0a91"}},{"code_sha256_prefix":"89bd4abf9c72da4f","entry":"DDLMVS","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"89bd4abf9c72da4f"}},{"code_sha256_prefix":"7ccf369a6cafb07a","entry":"DepthDecoder","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7ccf369a6cafb07a"}},{"code_sha256_prefix":"c0aa140f64e3d229","entry":"Evaluation","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0aa140f64e3d229"}},{"code_sha256_prefix":"338810fc5e2043a8","entry":"HSMNet","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"338810fc5e2043a8"}},{"code_sha256_prefix":"15bbcc83e8f87378","entry":"PSMNet","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15bbcc83e8f87378"}},{"code_sha256_prefix":"9c7781a0f6f917c4","entry":"PatchMatch","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c7781a0f6f917c4"}},{"code_sha256_prefix":"117934fc23392abd","entry":"Refinement","repo":"Mirmix/ddlmvs","repo_kind":"listed","path":"models/net.py","file_url":"https://github.com/Mirmix/ddlmvs/blob/HEAD/models/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"117934fc23392abd"}},{"code_sha256_prefix":"4af63eb5010aaaf7","entry":"ResnetEncoder","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4af63eb5010aaaf7"}},{"code_sha256_prefix":"12cf0361c050441b","entry":"SDFilter","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12cf0361c050441b"}},{"code_sha256_prefix":"c8a3ac84df7ddea3","entry":"SMDHead","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8a3ac84df7ddea3"}},{"code_sha256_prefix":"e2fb247c688205e5","entry":"gaussian_blur","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2fb247c688205e5"}},{"code_sha256_prefix":"23b44af6dc3ed7f3","entry":"get_backbone","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23b44af6dc3ed7f3"}},{"code_sha256_prefix":"47c7f7aa6bec2802","entry":"hourglass","repo":"fabiotosi92/SMD-Nets","repo_kind":"official","path":"lib/model/SMDHead.py","file_url":"https://github.com/fabiotosi92/SMD-Nets/blob/HEAD/lib/model/SMDHead.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"47c7f7aa6bec2802"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}