{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/what-you-see-is-what-you-get-exploiting","title":"What You See is What You Get: Exploiting Visibility for 3D Object Detection","arxiv_id":"1912.04986","date":"2019-12-10","proceeding":"CVPR 2020 6","authors":["Peiyun Hu","Jason Ziglar","David Held","Deva Ramanan"],"abstract":"Recent advances in 3D sensing have created unique challenges for computer vision. One fundamental challenge is finding a good representation for 3D sensor data. Most popular representations (such as PointNet) are proposed in the context of processing truly 3D data (e.g. points sampled from mesh models), ignoring the fact that 3D sensored data such as a LiDAR sweep is in fact 2.5D. We argue that representing 2.5D data as collections of (x, y, z) points fundamentally destroys hidden information about freespace. In this paper, we demonstrate such knowledge can be efficiently recovered through 3D raycasting and readily incorporated into batch-based gradient learning. We describe a simple approach to augmenting voxel-based networks with visibility: we add a voxelized visibility map as an additional input stream. In addition, we show that visibility can be combined with two crucial modifications common to state-of-the-art 3D detectors: synthetic data augmentation of virtual objects and temporal aggregation of LiDAR sweeps over multiple time frames. On the NuScenes 3D detection benchmark, we show that, by adding an additional stream for visibility input, we can significantly improve the overall detection accuracy of a state-of-the-art 3D detector.","url_abs":"https://arxiv.org/abs/1912.04986v3","url_pdf":"https://arxiv.org/pdf/1912.04986v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"what-you-see-is-what-you-get-exploiting","repo_url":"https://github.com/peiyunh/wysiwyg","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1912.04986","atlas_url":"https://app.syntology.ai/?focus=1912.04986","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.04986"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/peiyunh/wysiwyg","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1c3ded2d44af0798","entry":"create_target_np","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/target_ops.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/target_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1c3ded2d44af0798"}},{"code_sha256_prefix":"abc7a1803bf35228","entry":"is_line_segment_cross","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/geometry.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/geometry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"abc7a1803bf35228"}},{"code_sha256_prefix":"de9bc527072ac4b0","entry":"is_line_segment_intersection_jit","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/geometry.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/geometry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"de9bc527072ac4b0"}},{"code_sha256_prefix":"6a7ad14559c54076","entry":"line_segment_intersection","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/geometry.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/geometry.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6a7ad14559c54076"}},{"code_sha256_prefix":"5635800b6a815a1e","entry":"second_box_encode","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/box_np_ops.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/box_np_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"5635800b6a815a1e"}},{"code_sha256_prefix":"2902bedb7c18b1a1","entry":"unmap","repo":"peiyunh/wysiwyg","repo_kind":"official","path":"second/core/target_ops.py","file_url":"https://github.com/peiyunh/wysiwyg/blob/HEAD/second/core/target_ops.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2902bedb7c18b1a1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}