{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/panic-3d-stylized-single-view-3d","title":"PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characters","arxiv_id":"2303.14587","date":"2023-03-25","proceeding":"CVPR 2023 1","authors":["Shuhong Chen","Kevin Zhang","Yichun Shi","Heng Wang","Yiheng Zhu","Guoxian Song","Sizhe An","Janus Kristjansson","Xiao Yang","Matthias Zwicker"],"abstract":"We propose PAniC-3D, a system to reconstruct stylized 3D character heads directly from illustrated (p)ortraits of (ani)me (c)haracters. Our anime-style domain poses unique challenges to single-view reconstruction; compared to natural images of human heads, character portrait illustrations have hair and accessories with more complex and diverse geometry, and are shaded with non-photorealistic contour lines. In addition, there is a lack of both 3D model and portrait illustration data suitable to train and evaluate this ambiguous stylized reconstruction task. Facing these challenges, our proposed PAniC-3D architecture crosses the illustration-to-3D domain gap with a line-filling model, and represents sophisticated geometries with a volumetric radiance field. We train our system with two large new datasets (11.2k Vroid 3D models, 1k Vtuber portrait illustrations), and evaluate on a novel AnimeRecon benchmark of illustration-to-3D pairs. PAniC-3D significantly outperforms baseline methods, and provides data to establish the task of stylized reconstruction from portrait illustrations.","url_abs":"https://arxiv.org/abs/2303.14587v1","url_pdf":"https://arxiv.org/pdf/2303.14587v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"panic-3d-stylized-single-view-3d","repo_url":"https://github.com/shuhongchen/panic3d-anime-reconstruction","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-architecture","task_name":"3D Architecture"},{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"single-view-3d-reconstruction","task_name":"Single-View 3D Reconstruction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.14587","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}