{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/affine-transformation-of-virtual-3d-object","title":"Affine transformation of virtual 3D object using 2D localization of fingertips","arxiv_id":null,"date":"2020-10-27","proceeding":null,"authors":["Mohammad Mahmudul Alam","S. M. Mahbubur Rahman"],"abstract":"Background\r\nInteractions with virtual 3D objects in the virtual reality (VR) environment using the gesture of fingers captured in a wearable 2D camera have emerging applications in real-life.\r\n\r\nMethod\r\nThis paper presents an approach of a two-stage convolutional neural network, one for the detection of hand and another for the fingertips. One purpose of VR environments is to transform a virtual 3D object with affine parameters by using the gesture of thumb and index fingers.\r\n\r\nResults\r\nTo evaluate the performance of the proposed system, one existing, and another developed egocentric fingertip databases are employed so that learning involves large variations that are common in real-life. Experimental results show that the proposed fingertip detection system outperforms the existing systems in terms of the precision of detection.\r\n\r\nConclusion\r\nThe interaction performance of the proposed system in the VR environment is higher than that of the existing systems in terms of estimation error and correlation between the ground truth and estimated affine parameters.","url_abs":"https://www.sciencedirect.com/science/article/pii/S2096579620300917","url_pdf":"https://www.sciencedirect.com/science/article/pii/S2096579620300917","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"affine-transformation-of-virtual-3d-object","repo_url":"https://github.com/MahmudulAlam/TI1K-Dataset","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"fingertip-detection","task_name":"Fingertip Detection"},{"task_slug":"hand-detection","task_name":"Hand Detection"},{"task_slug":"hand-gesture-recognition","task_name":"Hand Gesture Recognition"},{"task_slug":"mixed-reality","task_name":"Mixed Reality"},{"task_slug":"unity","task_name":"Unity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}