{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vrkitchen-an-interactive-3d-virtual","title":"VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning","arxiv_id":"1903.05757","date":"2019-03-13","proceeding":null,"authors":["Xiaofeng Gao","Ran Gong","Tianmin Shu","Xu Xie","Shu Wang","Song-Chun Zhu"],"abstract":"One of the main challenges of advancing task-oriented learning such as visual\ntask planning and reinforcement learning is the lack of realistic and\nstandardized environments for training and testing AI agents. Previously,\nresearchers often relied on ad-hoc lab environments. There have been recent\nadvances in virtual systems built with 3D physics engines and photo-realistic\nrendering for indoor and outdoor environments, but the embodied agents in those\nsystems can only conduct simple interactions with the world (e.g., walking\naround, moving objects, etc.). Most of the existing systems also do not allow\nhuman participation in their simulated environments. In this work, we design\nand implement a virtual reality (VR) system, VRKitchen, with integrated\nfunctions which i) enable embodied agents powered by modern AI methods (e.g.,\nplanning, reinforcement learning, etc.) to perform complex tasks involving a\nwide range of fine-grained object manipulations in a realistic environment, and\nii) allow human teachers to perform demonstrations to train agents (i.e.,\nlearning from demonstration). We also provide standardized evaluation\nbenchmarks and data collection tools to facilitate a broad use in research on\ntask-oriented learning and beyond.","url_abs":"http://arxiv.org/abs/1903.05757v1","url_pdf":"http://arxiv.org/pdf/1903.05757v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vrkitchen-an-interactive-3d-virtual","repo_url":"https://github.com/xfgao/VRKitchen","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"task-planning","task_name":"Task Planning"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1903.05757","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}