Papers › Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfer

Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfer

5 Apr 2021CVPR 2021 1arXiv:2104.01867archive 2025-07-28

Thao Nguyen, Anh Tran, Minh Hoai

Makeup transfer is the task of applying on a source face the makeup style from a reference image. Real-life makeups are diverse and wild, which cover not only color-changing but also patterns, such as stickers, blushes, and jewelries. However, existing works overlooked the latter components and confined makeup transfer to color manipulation, focusing only on light makeup styles. In this work, we propose a holistic makeup transfer framework that can handle all the mentioned makeup components. It consists of an improved color transfer branch and a novel pattern transfer branch to learn all makeup properties, including color, shape, texture, and location. To train and evaluate such a system, we also introduce new makeup datasets for real and synthetic extreme makeup. Experimental results show that our framework achieves the state of the art performance on both light and extreme makeup styles. Code is available at https://github.com/VinAIResearch/CPM.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

VinAIResearch/CPM officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Color ManipulationFacial Makeup TransferStyle TransferVirtual Try-on

Datasets

Introduced by this paper, per the archive.

CPM-RealCPM-Synt-1CPM-Synt-2Stickers

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Makeup Transfer CPM-Synt-1 CPM mIOU 0.788 #1 of 1 Archive leaderboard report
Facial Makeup Transfer CPM-Synt-2 CPM MS-SSIM 0.977 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Batch NormalizationConvolutionCycle Consistency LossGAN Least Squares LossInstance NormalizationPatchGANReLUResidual BlockResidual ConnectionSigmoid ActivationTanh Activation

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections