{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/to-scene-a-large-scale-dataset-for","title":"TO-Scene: A Large-scale Dataset for Understanding 3D Tabletop Scenes","arxiv_id":"2203.09440","date":"2022-03-17","proceeding":null,"authors":["Mutian Xu","Pei Chen","Haolin Liu","Xiaoguang Han"],"abstract":"Many basic indoor activities such as eating or writing are always conducted upon different tabletops (e.g., coffee tables, writing desks). It is indispensable to understanding tabletop scenes in 3D indoor scene parsing applications. Unfortunately, it is hard to meet this demand by directly deploying data-driven algorithms, since 3D tabletop scenes are rarely available in current datasets. To remedy this defect, we introduce TO-Scene, a large-scale dataset focusing on tabletop scenes, which contains 20,740 scenes with three variants. To acquire the data, we design an efficient and scalable framework, where a crowdsourcing UI is developed to transfer CAD objects from ModelNet and ShapeNet onto tables from ScanNet, then the output tabletop scenes are simulated into real scans and annotated automatically. Further, a tabletop-aware learning strategy is proposed for better perceiving the small-sized tabletop instances. Notably, we also provide a real scanned test set TO-Real to verify the practical value of TO-Scene. Experiments show that the algorithms trained on TO-Scene indeed work on the realistic test data, and our proposed tabletop-aware learning strategy greatly improves the state-of-the-art results on both 3D semantic segmentation and object detection tasks. Dataset and code are available at https://github.com/GAP-LAB-CUHK-SZ/TO-Scene.","url_abs":"https://arxiv.org/abs/2203.09440v3","url_pdf":"https://arxiv.org/pdf/2203.09440v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"to-scene-a-large-scale-dataset-for","repo_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-semantic-segmentation","task_name":"3D Semantic Segmentation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"scene-parsing","task_name":"Scene Parsing"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.09440","atlas_url":"https://app.syntology.ai/?focus=2203.09440","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.09440"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"ran_violates":1,"ran":1,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"eddd23cbbb297813","entry":"flip_axis_to_camera","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"obj_det/models/ap_helper.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/obj_det/models/ap_helper.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eddd23cbbb297813"}},{"code_sha256_prefix":"d01e418562a2f61b","entry":"get_color","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"sem_seg/vis_tocrowd.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/sem_seg/vis_tocrowd.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d01e418562a2f61b"}},{"code_sha256_prefix":"7457a44fbe4c2d1d","entry":"rotate_aligned_boxes","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"obj_det/dataset/TOS_scene_dataset.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/obj_det/dataset/TOS_scene_dataset.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7457a44fbe4c2d1d"}},{"code_sha256_prefix":"74b9f07a52401d24","entry":"decode_scores","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"obj_det/models/proposal_module.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/obj_det/models/proposal_module.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74b9f07a52401d24"}},{"code_sha256_prefix":"d638b0201b9a9ece","entry":"flip_axis_to_depth","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"obj_det/models/ap_helper.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/obj_det/models/ap_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d638b0201b9a9ece"}},{"code_sha256_prefix":"1a034a72c15f9903","entry":"softmax","repo":"GAP-LAB-CUHK-SZ/TO-Scene","repo_kind":"official","path":"obj_det/models/ap_helper.py","file_url":"https://github.com/GAP-LAB-CUHK-SZ/TO-Scene/blob/HEAD/obj_det/models/ap_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1a034a72c15f9903"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}