{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/context-aware-mixed-reality-a-framework-for","title":"Context-Aware Mixed Reality: A Framework for Ubiquitous Interaction","arxiv_id":"1803.05541","date":"2018-03-14","proceeding":null,"authors":["Long Chen","Wen Tang","Nigel John","Tao Ruan Wan","Jian Jun Zhang"],"abstract":"Mixed Reality (MR) is a powerful interactive technology that yields new types\nof user experience. We present a semantic based interactive MR framework that\nexceeds the current geometry level approaches, a step change in generating\nhigh-level context-aware interactions. Our key insight is to build semantic\nunderstanding in MR that not only can greatly enhance user experience through\nobject-specific behaviours, but also pave the way for solving complex\ninteraction design challenges. The framework generates semantic properties of\nthe real world environment through dense scene reconstruction and deep image\nunderstanding. We demonstrate our approach with a material-aware prototype\nsystem for generating context-aware physical interactions between the real and\nthe virtual objects. Quantitative and qualitative evaluations are carried out\nand the results show that the framework delivers accurate and fast semantic\ninformation in interactive MR environment, providing effective semantic level\ninteractions.","url_abs":"http://arxiv.org/abs/1803.05541v1","url_pdf":"http://arxiv.org/pdf/1803.05541v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"context-aware-mixed-reality-a-framework-for","repo_url":"https://github.com/Aizierjiang/mr","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"mixed-reality","task_name":"Mixed Reality"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}