{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/kitti-360-a-novel-dataset-and-benchmarks-for","title":"KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D","arxiv_id":"2109.13410","date":"2021-09-28","proceeding":null,"authors":["Yiyi Liao","Jun Xie","Andreas Geiger"],"abstract":"For the last few decades, several major subfields of artificial intelligence including computer vision, graphics, and robotics have progressed largely independently from each other. Recently, however, the community has realized that progress towards robust intelligent systems such as self-driving cars requires a concerted effort across the different fields. This motivated us to develop KITTI-360, successor of the popular KITTI dataset. KITTI-360 is a suburban driving dataset which comprises richer input modalities, comprehensive semantic instance annotations and accurate localization to facilitate research at the intersection of vision, graphics and robotics. For efficient annotation, we created a tool to label 3D scenes with bounding primitives and developed a model that transfers this information into the 2D image domain, resulting in over 150k images and 1B 3D points with coherent semantic instance annotations across 2D and 3D. Moreover, we established benchmarks and baselines for several tasks relevant to mobile perception, encompassing problems from computer vision, graphics, and robotics on the same dataset, e.g., semantic scene understanding, novel view synthesis and semantic SLAM. KITTI-360 will enable progress at the intersection of these research areas and thus contribute towards solving one of today's grand challenges: the development of fully autonomous self-driving systems.","url_abs":"https://arxiv.org/abs/2109.13410v2","url_pdf":"https://arxiv.org/pdf/2109.13410v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"kitti-360-a-novel-dataset-and-benchmarks-for","repo_url":"https://github.com/autonomousvision/kitti360labeltool","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"kitti-360-a-novel-dataset-and-benchmarks-for","repo_url":"https://github.com/autonomousvision/kitti360scripts","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"multiple-object-tracking","task_name":"Multiple Object Tracking"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"self-driving-cars","task_name":"Self-Driving Cars"},{"task_slug":"semantic-slam","task_name":"Semantic SLAM"}],"methods":[],"datasets_introduced":[{"slug":"kitti-360","name":"KITTI-360","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2109.13410","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.13410"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/autonomousvision/kitti360labeltool","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/autonomousvision/kitti360scripts","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":14},"by_repo_kind":{"official":{"samples":16,"ran":2,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"27aa4c3bde697bf7","entry":"parse_header","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/ply.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/ply.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"27aa4c3bde697bf7"}},{"code_sha256_prefix":"5f8cf95da4e4af73","entry":"parse_mesh_header","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/ply.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/ply.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f8cf95da4e4af73"}},{"code_sha256_prefix":"1bbbf9f4bf965ba6","entry":"assureSingleInstanceName","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/labels.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/labels.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1bbbf9f4bf965ba6"}},{"code_sha256_prefix":"3e518c53b4c82b9c","entry":"check_credentials","repo":"autonomousvision/kitti360labeltool","repo_kind":"official","path":"user_auth.py","file_url":"https://github.com/autonomousvision/kitti360labeltool/blob/HEAD/user_auth.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e518c53b4c82b9c"}},{"code_sha256_prefix":"a6f77a1ff9252531","entry":"encrypt_password","repo":"autonomousvision/kitti360labeltool","repo_kind":"official","path":"create_db.py","file_url":"https://github.com/autonomousvision/kitti360labeltool/blob/HEAD/create_db.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a6f77a1ff9252531"}},{"code_sha256_prefix":"f235ef5bfd12fdd2","entry":"getColorEntry","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/csHelpers.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/csHelpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f235ef5bfd12fdd2"}},{"code_sha256_prefix":"d4af60d2845431e4","entry":"getFileInfo","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/csHelpers.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/csHelpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4af60d2845431e4"}},{"code_sha256_prefix":"5cac5b94e4a3b6b4","entry":"getWindowInfo","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/csHelpers.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/csHelpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cac5b94e4a3b6b4"}},{"code_sha256_prefix":"c1ba03a3f28f565d","entry":"global2local","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/annotation.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/annotation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1ba03a3f28f565d"}},{"code_sha256_prefix":"6d30ae1acdf4af14","entry":"loadCalibrationCameraToPose","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/devkits/commons/loadCalibration.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/devkits/commons/loadCalibration.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d30ae1acdf4af14"}},{"code_sha256_prefix":"a40cbfe9e1c016c8","entry":"loadCalibrationRigid","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/devkits/commons/loadCalibration.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/devkits/commons/loadCalibration.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a40cbfe9e1c016c8"}},{"code_sha256_prefix":"9e00fccb6ac72c2b","entry":"local2global","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/annotation.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/annotation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e00fccb6ac72c2b"}},{"code_sha256_prefix":"85785df0aa43aad5","entry":"member_of","repo":"autonomousvision/kitti360labeltool","repo_kind":"official","path":"user_auth.py","file_url":"https://github.com/autonomousvision/kitti360labeltool/blob/HEAD/user_auth.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"85785df0aa43aad5"}},{"code_sha256_prefix":"b2d5935b7fbd3050","entry":"readVariable","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/devkits/commons/loadCalibration.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/devkits/commons/loadCalibration.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2d5935b7fbd3050"}},{"code_sha256_prefix":"b6e0a4c988640904","entry":"readYAMLFile","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/project.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/project.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6e0a4c988640904"}},{"code_sha256_prefix":"1e26a8ee45f6722c","entry":"read_ply","repo":"autonomousvision/kitti360scripts","repo_kind":"official","path":"kitti360scripts/helpers/ply.py","file_url":"https://github.com/autonomousvision/kitti360scripts/blob/HEAD/kitti360scripts/helpers/ply.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e26a8ee45f6722c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}