{"url":"/dataset/talk2car","name":"Talk2Car","full_name":null,"description_markdown":"The **Talk2Car** dataset finds itself at the intersection of various research domains, promoting the development of cross-disciplinary solutions for improving the state-of-the-art in grounding natural language into visual space. The annotations were gathered with the following aspects in mind:\r\nFree-form high quality natural language commands, that stimulate the development of solutions that can operate in the wild.\r\nA realistic task setting. Specifically, the authors consider an autonomous driving setting, where a passenger can control the actions of an Autonomous Vehicle by giving commands in natural language.\r\nThe Talk2Car dataset was build on top of the nuScenes dataset to include an extensive suite of sensor modalities, i.e. semantic maps, GPS, LIDAR, RADAR and 360-degree RGB images annotated with 3D bounding boxes. Such variety of input modalities sets the object referral task on the Talk2Car dataset apart from related challenges, where additional sensor modalities are generally missing.\r\n\r\nSource: [https://talk2car.github.io/](https://talk2car.github.io/)\nImage Source: [https://github.com/talk2car/Talk2Car](https://github.com/talk2car/Talk2Car)","description_withheld":null,"homepage":"https://github.com/talk2car/Talk2Car","introduced_date":null,"introduced_date_note":null,"introduced_by":{"paper":"/paper/talk2car-taking-control-of-your-self-driving","title":"Talk2Car: Taking Control of Your Self-Driving Car","first_author":"Thierry Deruyttere","url":null},"license":null,"modalities":[{"name":"Images","url":"/datasets/modality/images"}],"tasks":[{"name":"Autonomous Vehicles","url":"/task/autonomous-vehicles","datasets_with_task":"/datasets/task/autonomous-vehicles"},{"name":"Autonomous Driving","url":"/task/autonomous-driving","datasets_with_task":"/datasets/task/autonomous-driving"},{"name":"Referring Expression Comprehension","url":"/task/referring-expression-comprehension","datasets_with_task":"/datasets/task/referring-expression-comprehension"},{"name":"Self-Driving Cars","url":"/task/self-driving-cars","datasets_with_task":"/datasets/task/self-driving-cars"}],"languages":[],"variants":["Talk2Car"],"data_loaders":[{"repo":"https://github.com/talk2car/Talk2Car","url":"https://github.com/talk2car/Talk2Car","frameworks":["pytorch"]}],"num_papers_in_archive":45,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-25T09:33:49+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}