{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hololens-2-research-mode-as-a-tool-for","title":"HoloLens 2 Research Mode as a Tool for Computer Vision Research","arxiv_id":"2008.11239","date":"2020-08-25","proceeding":null,"authors":["Dorin Ungureanu","Federica Bogo","Silvano Galliani","Pooja Sama","Xin Duan","Casey Meekhof","Jan Stühmer","Thomas J. Cashman","Bugra Tekin","Johannes L. Schönberger","Pawel Olszta","Marc Pollefeys"],"abstract":"Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.","url_abs":"https://arxiv.org/abs/2008.11239v1","url_pdf":"https://arxiv.org/pdf/2008.11239v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hololens-2-research-mode-as-a-tool-for","repo_url":"https://github.com/microsoft/HoloLens2ForCV","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"hololens-2-research-mode-as-a-tool-for","repo_url":"https://github.com/it3dego/it3dego","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"mixed-reality","task_name":"Mixed Reality"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2008.11239","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}