{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hyperreenact-one-shot-reenactment-via-jointly","title":"HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces","arxiv_id":"2307.10797","date":"2023-07-20","proceeding":"ICCV 2023 1","authors":["Stella Bounareli","Christos Tzelepis","Vasileios Argyriou","Ioannis Patras","Georgios Tzimiropoulos"],"abstract":"In this paper, we present our method for neural face reenactment, called HyperReenact, that aims to generate realistic talking head images of a source identity, driven by a target facial pose. Existing state-of-the-art face reenactment methods train controllable generative models that learn to synthesize realistic facial images, yet producing reenacted faces that are prone to significant visual artifacts, especially under the challenging condition of extreme head pose changes, or requiring expensive few-shot fine-tuning to better preserve the source identity characteristics. We propose to address these limitations by leveraging the photorealistic generation ability and the disentangled properties of a pretrained StyleGAN2 generator, by first inverting the real images into its latent space and then using a hypernetwork to perform: (i) refinement of the source identity characteristics and (ii) facial pose re-targeting, eliminating this way the dependence on external editing methods that typically produce artifacts. Our method operates under the one-shot setting (i.e., using a single source frame) and allows for cross-subject reenactment, without requiring any subject-specific fine-tuning. We compare our method both quantitatively and qualitatively against several state-of-the-art techniques on the standard benchmarks of VoxCeleb1 and VoxCeleb2, demonstrating the superiority of our approach in producing artifact-free images, exhibiting remarkable robustness even under extreme head pose changes. We make the code and the pretrained models publicly available at: https://github.com/StelaBou/HyperReenact .","url_abs":"https://arxiv.org/abs/2307.10797v1","url_pdf":"https://arxiv.org/pdf/2307.10797v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hyperreenact-one-shot-reenactment-via-jointly","repo_url":"https://github.com/stelabou/hyperreenact","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"face-reenactment","task_name":"Face Reenactment"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"hypernetwork","method_name":"HyperNetwork"},{"method_slug":"path-length-regularization","method_name":"Path Length Regularization"},{"method_slug":"r1-regularization","method_name":"R1 Regularization"},{"method_slug":"weight-demodulation","method_name":"Weight Demodulation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2307.10797","atlas_url":"https://app.syntology.ai/?focus=2307.10797","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.10797"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/stelabou/hyperreenact","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":3,"ran":2,"ran_honours":2},"by_repo_kind":{"official":{"samples":7,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"5baaa8c1b148ef70","entry":"conv3x3","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/face_models/fan_model/models.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/face_models/fan_model/models.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5baaa8c1b148ef70"}},{"code_sha256_prefix":"3d55ff19b6224358","entry":"find_affine_transformation","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/criteria/csim.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/criteria/csim.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3d55ff19b6224358"}},{"code_sha256_prefix":"ad5dbf57f3ea2633","entry":"get_block","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/criteria/csim.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/criteria/csim.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ad5dbf57f3ea2633"}},{"code_sha256_prefix":"b28543ed94f9d144","entry":"get_block","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/criteria/helpers.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/criteria/helpers.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b28543ed94f9d144"}},{"code_sha256_prefix":"d764d1b681a351f3","entry":"get_blocks","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/criteria/helpers.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/criteria/helpers.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d764d1b681a351f3"}},{"code_sha256_prefix":"4e3b20f2a7279c67","entry":"get_preds_fromhm","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/face_models/landmarks_estimation.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/face_models/landmarks_estimation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4e3b20f2a7279c67"}},{"code_sha256_prefix":"c54fea429589425d","entry":"l2_norm","repo":"stelabou/hyperreenact","repo_kind":"official","path":"libs/criteria/csim.py","file_url":"https://github.com/stelabou/hyperreenact/blob/HEAD/libs/criteria/csim.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c54fea429589425d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}