{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-robotrix-an-extremely-photorealistic-and","title":"The RobotriX: An eXtremely Photorealistic and Very-Large-Scale Indoor Dataset of Sequences with Robot Trajectories and Interactions","arxiv_id":"1901.06514","date":"2019-01-19","proceeding":null,"authors":["Alberto Garcia-Garcia","Pablo Martinez-Gonzalez","Sergiu Oprea","John Alejandro Castro-Vargas","Sergio Orts-Escolano","Jose Garcia-Rodriguez","Alvaro Jover-Alvarez"],"abstract":"Enter the RobotriX, an extremely photorealistic indoor dataset designed to\nenable the application of deep learning techniques to a wide variety of robotic\nvision problems. The RobotriX consists of hyperrealistic indoor scenes which\nare explored by robot agents which also interact with objects in a visually\nrealistic manner in that simulated world. Photorealistic scenes and robots are\nrendered by Unreal Engine into a virtual reality headset which captures gaze so\nthat a human operator can move the robot and use controllers for the robotic\nhands; scene information is dumped on a per-frame basis so that it can be\nreproduced offline to generate raw data and ground truth labels. By taking this\napproach, we were able to generate a dataset of 38 semantic classes totaling 8M\nstills recorded at +60 frames per second with full HD resolution. For each\nframe, RGB-D and 3D information is provided with full annotations in both\nspaces. Thanks to the high quality and quantity of both raw information and\nannotations, the RobotriX will serve as a new milestone for investigating 2D\nand 3D robotic vision tasks with large-scale data-driven techniques.","url_abs":"http://arxiv.org/abs/1901.06514v1","url_pdf":"http://arxiv.org/pdf/1901.06514v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-robotrix-an-extremely-photorealistic-and","repo_url":"https://github.com/3dperceptionlab/therobotrix","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"robotic-grasping","task_name":"Robotic Grasping"}],"methods":[],"datasets_introduced":[{"slug":"the-robotrix","name":"The RobotriX","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1901.06514","atlas_url":"https://app.syntology.ai/?focus=1901.06514","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}