{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arshoe-real-time-augmented-reality-shoe-try","title":"ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones","arxiv_id":"2108.10515","date":"2021-08-24","proceeding":null,"authors":["Shan An","Guangfu Che","Jinghao Guo","Haogang Zhu","Junjie Ye","Fangru Zhou","Zhaoqi Zhu","Dong Wei","Aishan Liu","Wei zhang"],"abstract":"Virtual try-on technology enables users to try various fashion items using augmented reality and provides a convenient online shopping experience. However, most previous works focus on the virtual try-on for clothes while neglecting that for shoes, which is also a promising task. To this concern, this work proposes a real-time augmented reality virtual shoe try-on system for smartphones, namely ARShoe. Specifically, ARShoe adopts a novel multi-branch network to realize pose estimation and segmentation simultaneously. A solution to generate realistic 3D shoe model occlusion during the try-on process is presented. To achieve a smooth and stable try-on effect, this work further develop a novel stabilization method. Moreover, for training and evaluation, we construct the very first large-scale foot benchmark with multiple virtual shoe try-on task-related labels annotated. Exhaustive experiments on our newly constructed benchmark demonstrate the satisfying performance of ARShoe. Practical tests on common smartphones validate the real-time performance and stabilization of the proposed approach.","url_abs":"https://arxiv.org/abs/2108.10515v1","url_pdf":"https://arxiv.org/pdf/2108.10515v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"virtual-try-on","task_name":"Virtual Try-on"}],"methods":[{"method_slug":"arshoe","method_name":"ARShoe"}],"datasets_introduced":[],"methods_introduced":[{"slug":"arshoe","name":"ARShoe","full_name":"ARShoe"}],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}