{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-topology-from-synthetic-data-for","title":"Learning Topology from Synthetic Data for Unsupervised Depth Completion","arxiv_id":"2106.02994","date":"2021-06-06","proceeding":null,"authors":["Alex Wong","Safa Cicek","Stefano Soatto"],"abstract":"We present a method for inferring dense depth maps from images and sparse depth measurements by leveraging synthetic data to learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate the predicted depth map. Our learned prior for natural shapes uses only sparse depth as input, not images, so the method is not affected by the covariate shift when attempting to transfer learned models from synthetic data to real ones. This allows us to use abundant synthetic data with ground truth to learn the most difficult component of the reconstruction process, which is topology estimation, and use the image to refine the prediction based on photometric evidence. Our approach uses fewer parameters than previous methods, yet, achieves the state of the art on both indoor and outdoor benchmark datasets. Code available at: https://github.com/alexklwong/learning-topology-synthetic-data.","url_abs":"https://arxiv.org/abs/2106.02994v3","url_pdf":"https://arxiv.org/pdf/2106.02994v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-topology-from-synthetic-data-for","repo_url":"https://github.com/alexklwong/learning-topology-synthetic-data","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"depth-completion","task_name":"Depth Completion"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/depth-completion-on-kitti-depth-completion","task":"Depth Completion","dataset":"KITTI Depth Completion","model":"ScaffNet-FusionNet","rank_in_archive_order":13,"of":16,"metrics":{"MAE":"280.76","RMSE":"1121.93","iMAE":"1.15","iRMSE":"3.30"},"uses_additional_data":false},{"leaderboard":"/sota/depth-completion-on-void","task":"Depth Completion","dataset":"VOID","model":"ScaffNet-FusionNet","rank_in_archive_order":3,"of":6,"metrics":{"MAE":"59.53","RMSE":"119.14","iMAE":"35.72","iRMSE":"68.36"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2106.02994","atlas_url":"https://app.syntology.ai/?focus=2106.02994","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}