{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/geometry-aware-instance-segmentation-with","title":"Geometry-Aware Instance Segmentation with Disparity Maps","arxiv_id":"2006.07802","date":"2020-06-14","proceeding":null,"authors":["Cho-Ying Wu","Xiaoyan Hu","Michael Happold","Qiangeng Xu","Ulrich Neumann"],"abstract":"Most previous works of outdoor instance segmentation for images only use color information. We explore a novel direction of sensor fusion to exploit stereo cameras. Geometric information from disparities helps separate overlapping objects of the same or different classes. Moreover, geometric information penalizes region proposals with unlikely 3D shapes thus suppressing false positive detections. Mask regression is based on 2D, 2.5D, and 3D ROI using the pseudo-lidar and image-based representations. These mask predictions are fused by a mask scoring process. However, public datasets only adopt stereo systems with shorter baseline and focal legnth, which limit measuring ranges of stereo cameras. We collect and utilize High-Quality Driving Stereo (HQDS) dataset, using much longer baseline and focal length with higher resolution. Our performance attains state of the art. Please refer to our project page. The full paper is available here.","url_abs":"https://arxiv.org/abs/2006.07802v2","url_pdf":"https://arxiv.org/pdf/2006.07802v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"geometry-aware-instance-segmentation-with","repo_url":"https://github.com/choyingw/GAIS-Net","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"sensor-fusion","task_name":"Sensor Fusion"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/instance-segmentation-on-cityscapes","task":"Instance Segmentation","dataset":"Cityscapes test","model":"GAIS-Net","rank_in_archive_order":10,"of":11,"metrics":{},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-cityscapes-val","task":"Instance Segmentation","dataset":"Cityscapes val","model":"GAIS-Net","rank_in_archive_order":16,"of":17,"metrics":{"mask AP":"37.1"},"uses_additional_data":true}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}