{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cityscapes-3d-dataset-and-benchmark-for-9-dof","title":"Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection","arxiv_id":"2006.07864","date":"2020-06-14","proceeding":null,"authors":["Nils Gählert","Nicolas Jourdan","Marius Cordts","Uwe Franke","Joachim Denzler"],"abstract":"Detecting vehicles and representing their position and orientation in the three dimensional space is a key technology for autonomous driving. Recently, methods for 3D vehicle detection solely based on monocular RGB images gained popularity. In order to facilitate this task as well as to compare and drive state-of-the-art methods, several new datasets and benchmarks have been published. Ground truth annotations of vehicles are usually obtained using lidar point clouds, which often induces errors due to imperfect calibration or synchronization between both sensors. To this end, we propose Cityscapes 3D, extending the original Cityscapes dataset with 3D bounding box annotations for all types of vehicles. In contrast to existing datasets, our 3D annotations were labeled using stereo RGB images only and capture all nine degrees of freedom. This leads to a pixel-accurate reprojection in the RGB image and a higher range of annotations compared to lidar-based approaches. In order to ease multitask learning, we provide a pairing of 2D instance segments with 3D bounding boxes. In addition, we complement the Cityscapes benchmark suite with 3D vehicle detection based on the new annotations as well as metrics presented in this work. Dataset and benchmark are available online.","url_abs":"https://arxiv.org/abs/2006.07864v1","url_pdf":"https://arxiv.org/pdf/2006.07864v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cityscapes-3d-dataset-and-benchmark-for-9-dof","repo_url":"https://github.com/mcordts/cityscapesScripts","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"vehicle-detection","task_name":"vehicle detection"}],"methods":[],"datasets_introduced":[{"slug":"cityscapes-3d","name":"Cityscapes 3D","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2006.07864","atlas_url":"https://app.syntology.ai/?focus=2006.07864","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.07864"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mcordts/cityscapesScripts","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"ran_draft_wrong":1,"unverified":7},"by_repo_kind":{"listed":{"samples":18,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1fad03d954672ec0","entry":"apply_transformation_points","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/helpers/box3dImageTransform.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/helpers/box3dImageTransform.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1fad03d954672ec0"}},{"code_sha256_prefix":"2e4dc052748602d3","entry":"calcIouMatrix","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/objectDetectionHelpers.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/objectDetectionHelpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e4dc052748602d3"}},{"code_sha256_prefix":"7cf1c6823859df30","entry":"calcOverlapMatrix","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/objectDetectionHelpers.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/objectDetectionHelpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7cf1c6823859df30"}},{"code_sha256_prefix":"779046f7b137ee1f","entry":"create_all_axes","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/plot3dResults.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/plot3dResults.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"779046f7b137ee1f"}},{"code_sha256_prefix":"7d4554a0bd6eb4d2","entry":"generateInstanceStats","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d4554a0bd6eb4d2"}},{"code_sha256_prefix":"97456c01163f9e89","entry":"getFiles","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/objectDetectionHelpers.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/objectDetectionHelpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"97456c01163f9e89"}},{"code_sha256_prefix":"afc882b56c5fc8dc","entry":"get_available_items_scaling","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/plot3dResults.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/plot3dResults.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"afc882b56c5fc8dc"}},{"code_sha256_prefix":"83688d523b5a420f","entry":"get_projection_matrix","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/helpers/box3dImageTransform.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/helpers/box3dImageTransform.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"83688d523b5a420f"}},{"code_sha256_prefix":"72293b35c72b14b9","entry":"get_traceback","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"72293b35c72b14b9"}},{"code_sha256_prefix":"d17459eb66680bc5","entry":"parse_size_to_bytes","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/download/downloader.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/download/downloader.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d17459eb66680bc5"}},{"code_sha256_prefix":"c4ff2054485ea288","entry":"rgb2id","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4ff2054485ea288"}},{"code_sha256_prefix":"83f120a07b1755b4","entry":"generateMatrix","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"83f120a07b1755b4"}},{"code_sha256_prefix":"4117355862403f8e","entry":"getPrediction","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4117355862403f8e"}},{"code_sha256_prefix":"726c752cf4432acd","entry":"getPrediction","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPixelLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"726c752cf4432acd"}},{"code_sha256_prefix":"cb704b28ef740287","entry":"instances2dict","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/instances2dict.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/instances2dict.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cb704b28ef740287"}},{"code_sha256_prefix":"9a20bf896b7324bd","entry":"pq_compute_single_core","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalPanopticSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a20bf896b7324bd"}},{"code_sha256_prefix":"bc80100fca555b8d","entry":"readGTImage","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc80100fca555b8d"}},{"code_sha256_prefix":"5824e97f65f12b8d","entry":"readPredInfo","repo":"mcordts/cityscapesScripts","repo_kind":"listed","path":"cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","file_url":"https://github.com/mcordts/cityscapesScripts/blob/HEAD/cityscapesscripts/evaluation/evalInstanceLevelSemanticLabeling.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5824e97f65f12b8d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}