{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/pivotal-tuning-for-latent-based-editing-of","title":"Pivotal Tuning for Latent-based Editing of Real Images","arxiv_id":"2106.05744","date":"2021-06-10","proceeding":null,"authors":["Daniel Roich","Ron Mokady","Amit H. Bermano","Daniel Cohen-Or"],"abstract":"Recently, a surge of advanced facial editing techniques have been proposed that leverage the generative power of a pre-trained StyleGAN. To successfully edit an image this way, one must first project (or invert) the image into the pre-trained generator's domain. As it turns out, however, StyleGAN's latent space induces an inherent tradeoff between distortion and editability, i.e. between maintaining the original appearance and convincingly altering some of its attributes. Practically, this means it is still challenging to apply ID-preserving facial latent-space editing to faces which are out of the generator's domain. In this paper, we present an approach to bridge this gap. Our technique slightly alters the generator, so that an out-of-domain image is faithfully mapped into an in-domain latent code. The key idea is pivotal tuning - a brief training process that preserves the editing quality of an in-domain latent region, while changing its portrayed identity and appearance. In Pivotal Tuning Inversion (PTI), an initial inverted latent code serves as a pivot, around which the generator is fined-tuned. At the same time, a regularization term keeps nearby identities intact, to locally contain the effect. This surgical training process ends up altering appearance features that represent mostly identity, without affecting editing capabilities. We validate our technique through inversion and editing metrics, and show preferable scores to state-of-the-art methods. We further qualitatively demonstrate our technique by applying advanced edits (such as pose, age, or expression) to numerous images of well-known and recognizable identities. Finally, we demonstrate resilience to harder cases, including heavy make-up, elaborate hairstyles and/or headwear, which otherwise could not have been successfully inverted and edited by state-of-the-art methods.","url_abs":"https://arxiv.org/abs/2106.05744v1","url_pdf":"https://arxiv.org/pdf/2106.05744v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"pivotal-tuning-for-latent-based-editing-of","repo_url":"https://github.com/danielroich/PTI","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"pivotal-tuning-for-latent-based-editing-of","repo_url":"https://github.com/cloneofsimo/lora","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"pivotal-tuning-for-latent-based-editing-of","repo_url":"https://github.com/futscdav/Chunkmogrify","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"facial-editing","task_name":"Facial Editing"},{"task_slug":"image-manipulation","task_name":"Image Manipulation"}],"methods":[{"method_slug":"adaptive-instance-normalization","method_name":"Adaptive Instance Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"feedforward-network","method_name":"Feedforward Network"},{"method_slug":"r1-regularization","method_name":"R1 Regularization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2106.05744","atlas_url":"https://app.syntology.ai/?focus=2106.05744","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.05744"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/danielroich/PTI","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/futscdav/Chunkmogrify","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cloneofsimo/lora","reach":null}],"summary":{"ran":2,"unverified":2},"by_repo_kind":{"official":{"samples":2,"ran":0,"repositories":1},"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d793962f13865771","entry":"inpainting_dataloader","repo":"cloneofsimo/lora","repo_kind":"listed","path":"lora_diffusion/cli_lora_pti.py","file_url":"https://github.com/cloneofsimo/lora/blob/HEAD/lora_diffusion/cli_lora_pti.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d793962f13865771"}},{"code_sha256_prefix":"aa63f591fb2e9bd7","entry":"text2img_dataloader","repo":"cloneofsimo/lora","repo_kind":"listed","path":"lora_diffusion/cli_lora_pti.py","file_url":"https://github.com/cloneofsimo/lora/blob/HEAD/lora_diffusion/cli_lora_pti.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa63f591fb2e9bd7"}},{"code_sha256_prefix":"5aecdc0de1cf3f53","entry":"edit","repo":"danielroich/PTI","repo_kind":"official","path":"editings/ganspace.py","file_url":"https://github.com/danielroich/PTI/blob/HEAD/editings/ganspace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5aecdc0de1cf3f53"}},{"code_sha256_prefix":"f13e021711aea982","entry":"get_delta","repo":"danielroich/PTI","repo_kind":"official","path":"editings/ganspace.py","file_url":"https://github.com/danielroich/PTI/blob/HEAD/editings/ganspace.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f13e021711aea982"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}