Papers › 3D Cartoon Face Generation with Controllable Expressions from a Single GAN Image

3D Cartoon Face Generation with Controllable Expressions from a Single GAN Image

29 Jul 2022arXiv:2207.14425archive 2025-07-28

Hao Wang, Wenhao Shen, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao

In this paper, we investigate an open research task of generating 3D cartoon face shapes from single 2D GAN generated human faces and without 3D supervision, where we can also manipulate the facial expressions of the 3D shapes. To this end, we discover the semantic meanings of StyleGAN latent space, such that we are able to produce face images of various expressions, poses, and lighting conditions by controlling the latent codes. Specifically, we first finetune the pretrained StyleGAN face model on the cartoon datasets. By feeding the same latent codes to face and cartoon generation models, we aim to realize the translation from 2D human face images to cartoon styled avatars. We then discover semantic directions of the GAN latent space, in an attempt to change the facial expressions while preserving the original identity. As we do not have any 3D annotations for cartoon faces, we manipulate the latent codes to generate images with different poses and lighting conditions, such that we can reconstruct the 3D cartoon face shapes. We validate the efficacy of our method on three cartoon datasets qualitatively and quantitatively.

PaperPDFCode

Code

hwang1996/3D-Cartoon-Face-Generation officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Face GenerationFace Model

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Adaptive Instance NormalizationConvolutionDense ConnectionsFeedforward NetworkR1 RegularizationStyleGAN

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections