{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/liquid-warping-gan-with-attention-a-unified","title":"Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis","arxiv_id":"2011.09055","date":"2020-11-18","proceeding":null,"authors":["Wen Liu","Zhixin Piao","Zhi Tu","Wenhan Luo","Lin Ma","Shenghua Gao"],"abstract":"We tackle human image synthesis, including human motion imitation, appearance transfer, and novel view synthesis, within a unified framework. It means that the model, once being trained, can be used to handle all these tasks. The existing task-specific methods mainly use 2D keypoints to estimate the human body structure. However, they only express the position information with no abilities to characterize the personalized shape of the person and model the limb rotations. In this paper, we propose to use a 3D body mesh recovery module to disentangle the pose and shape. It can not only model the joint location and rotation but also characterize the personalized body shape. To preserve the source information, such as texture, style, color, and face identity, we propose an Attentional Liquid Warping GAN with Attentional Liquid Warping Block (AttLWB) that propagates the source information in both image and feature spaces to the synthesized reference. Specifically, the source features are extracted by a denoising convolutional auto-encoder for characterizing the source identity well. Furthermore, our proposed method can support a more flexible warping from multiple sources. To further improve the generalization ability of the unseen source images, a one/few-shot adversarial learning is applied. In detail, it firstly trains a model in an extensive training set. Then, it finetunes the model by one/few-shot unseen image(s) in a self-supervised way to generate high-resolution (512 x 512 and 1024 x 1024) results. Also, we build a new dataset, namely iPER dataset, for the evaluation of human motion imitation, appearance transfer, and novel view synthesis. Extensive experiments demonstrate the effectiveness of our methods in terms of preserving face identity, shape consistency, and clothes details. All codes and dataset are available on https://impersonator.org/work/impersonator-plus-plus.html.","url_abs":"https://arxiv.org/abs/2011.09055v2","url_pdf":"https://arxiv.org/pdf/2011.09055v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"liquid-warping-gan-with-attention-a-unified","repo_url":"https://github.com/iPERDance/iPERCore","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"liquid-warping-gan-with-attention-a-unified","repo_url":"https://github.com/xiandenis/iPERCore","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"appearance-transfer","task_name":"Appearance Transfer"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[{"method_slug":"attlwb","method_name":"AttLWB"},{"method_slug":"attentional-liquid-warping-gan","method_name":"Attentional Liquid Warping GAN"},{"method_slug":"spade","method_name":"SPADE"}],"datasets_introduced":[{"slug":"iper","name":"iPer","full_name":"Impersonator"}],"methods_introduced":[{"slug":"attlwb","name":"AttLWB","full_name":"Attentional Liquid Warping Block"},{"slug":"attentional-liquid-warping-gan","name":"Attentional Liquid Warping GAN","full_name":"Attentional Liquid Warping GAN"}],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2011.09055","atlas_url":"https://app.syntology.ai/?focus=2011.09055","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}