{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lipstick-ain-t-enough-beyond-color-matching","title":"Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfer","arxiv_id":"2104.01867","date":"2021-04-05","proceeding":"CVPR 2021 1","authors":["Thao Nguyen","Anh Tran","Minh Hoai"],"abstract":"Makeup transfer is the task of applying on a source face the makeup style from a reference image. Real-life makeups are diverse and wild, which cover not only color-changing but also patterns, such as stickers, blushes, and jewelries. However, existing works overlooked the latter components and confined makeup transfer to color manipulation, focusing only on light makeup styles. In this work, we propose a holistic makeup transfer framework that can handle all the mentioned makeup components. It consists of an improved color transfer branch and a novel pattern transfer branch to learn all makeup properties, including color, shape, texture, and location. To train and evaluate such a system, we also introduce new makeup datasets for real and synthetic extreme makeup. Experimental results show that our framework achieves the state of the art performance on both light and extreme makeup styles. Code is available at https://github.com/VinAIResearch/CPM.","url_abs":"https://arxiv.org/abs/2104.01867v1","url_pdf":"https://arxiv.org/pdf/2104.01867v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lipstick-ain-t-enough-beyond-color-matching","repo_url":"https://github.com/VinAIResearch/CPM","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"color-manipulation","task_name":"Color Manipulation"},{"task_slug":"facial-makeup-transfer","task_name":"Facial Makeup Transfer"},{"task_slug":"style-transfer","task_name":"Style Transfer"},{"task_slug":"virtual-try-on","task_name":"Virtual Try-on"}],"methods":[{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"cycle-consistency-loss","method_name":"Cycle Consistency Loss"},{"method_slug":"gan-least-squares-loss","method_name":"GAN Least Squares Loss"},{"method_slug":"instance-normalization","method_name":"Instance Normalization"},{"method_slug":"patchgan","method_name":"PatchGAN"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"tanh-activation","method_name":"Tanh Activation"}],"datasets_introduced":[{"slug":"cpm-real","name":"CPM-Real","full_name":""},{"slug":"cpm-synt-1","name":"CPM-Synt-1","full_name":"Color-Pattern-Makeup Synthesis 1"},{"slug":"cpm-synt-2","name":"CPM-Synt-2","full_name":"Color-Pattern-Makeup Synthesis 2"},{"slug":"stickers","name":"Stickers","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/facial-makeup-transfer-on-cpm-synt-1","task":"Facial Makeup Transfer","dataset":"CPM-Synt-1","model":"CPM","rank_in_archive_order":1,"of":1,"metrics":{"mIOU":"0.788"},"uses_additional_data":false},{"leaderboard":"/sota/facial-makeup-transfer-on-cpm-synt-2","task":"Facial Makeup Transfer","dataset":"CPM-Synt-2","model":"CPM","rank_in_archive_order":1,"of":1,"metrics":{"MS-SSIM":"0.977"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2104.01867","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}