{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/holoface-augmenting-human-to-human","title":"HoloFace: Augmenting Human-to-Human Interactions on HoloLens","arxiv_id":"1802.00278","date":"2018-02-01","proceeding":null,"authors":["Marek Kowalski","Zbigniew Nasarzewski","Grzegorz Galinski","Piotr Garbat"],"abstract":"We present HoloFace, an open-source framework for face alignment, head pose\nestimation and facial attribute retrieval for Microsoft HoloLens. HoloFace\nimplements two state-of-the-art face alignment methods which can be used\ninterchangeably: one running locally and one running on a remote backend. Head\npose estimation is accomplished by fitting a deformable 3D model to the\nlandmarks localized using face alignment. The head pose provides both the\nrotation of the head and a position in the world space. The parameters of the\nfitted 3D face model provide estimates of facial attributes such as mouth\nopening or smile. Together the above information can be used to augment the\nfaces of people seen by the HoloLens user, and thus their interaction.\nPotential usage scenarios include facial recognition, emotion recognition, eye\ngaze tracking and many others. We demonstrate the capabilities of our framework\nby augmenting the faces of people seen through the HoloLens with various\nobjects and animations.","url_abs":"http://arxiv.org/abs/1802.00278v1","url_pdf":"http://arxiv.org/pdf/1802.00278v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"holoface-augmenting-human-to-human","repo_url":"https://github.com/MarekKowalski/HoloFace","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"emotion-recognition","task_name":"Emotion Recognition"},{"task_slug":"face-alignment","task_name":"Face Alignment"},{"task_slug":"face-model","task_name":"Face Model"},{"task_slug":"head-pose-estimation","task_name":"Head Pose Estimation"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}