{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/photoverse-tuning-free-image-customization","title":"PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models","arxiv_id":"2309.05793","date":"2023-09-11","proceeding":null,"authors":["Li Chen","Mengyi Zhao","Yiheng Liu","Mingxu Ding","Yangyang Song","Shizun Wang","Xu Wang","Hao Yang","Jing Liu","Kang Du","Min Zheng"],"abstract":"Personalized text-to-image generation has emerged as a powerful and sought-after tool, empowering users to create customized images based on their specific concepts and prompts. However, existing approaches to personalization encounter multiple challenges, including long tuning times, large storage requirements, the necessity for multiple input images per identity, and limitations in preserving identity and editability. To address these obstacles, we present PhotoVerse, an innovative methodology that incorporates a dual-branch conditioning mechanism in both text and image domains, providing effective control over the image generation process. Furthermore, we introduce facial identity loss as a novel component to enhance the preservation of identity during training. Remarkably, our proposed PhotoVerse eliminates the need for test time tuning and relies solely on a single facial photo of the target identity, significantly reducing the resource cost associated with image generation. After a single training phase, our approach enables generating high-quality images within only a few seconds. Moreover, our method can produce diverse images that encompass various scenes and styles. The extensive evaluation demonstrates the superior performance of our approach, which achieves the dual objectives of preserving identity and facilitating editability. Project page: https://photoverse2d.github.io/","url_abs":"https://arxiv.org/abs/2309.05793v1","url_pdf":"https://arxiv.org/pdf/2309.05793v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"photoverse-tuning-free-image-customization","repo_url":"https://github.com/idonahum/photoVerse","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"text-to-image-generation-1","task_name":"Text to Image Generation"},{"task_slug":"text-to-image-generation","task_name":"Text-to-Image Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.05793","atlas_url":"https://app.syntology.ai/?focus=2309.05793","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.05793"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/idonahum/photoVerse","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"listed":{"samples":7,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"56c8eb1a25c430ac","entry":"collate_fn","repo":"idonahum/photoVerse","repo_kind":"listed","path":"datasets/custom.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/datasets/custom.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56c8eb1a25c430ac"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"idonahum/photoVerse","repo_kind":"listed","path":"models/arcface_resnet.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/models/arcface_resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"091788297b78b8f8","entry":"get_visual_cross_attention_values_norm","repo":"idonahum/photoVerse","repo_kind":"listed","path":"models/unet.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/models/unet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"091788297b78b8f8"}},{"code_sha256_prefix":"08ed26a26d2e9173","entry":"is_image","repo":"idonahum/photoVerse","repo_kind":"listed","path":"datasets/custom.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/datasets/custom.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08ed26a26d2e9173"}},{"code_sha256_prefix":"3c499a6b2e9532db","entry":"load_photoverse_model","repo":"idonahum/photoVerse","repo_kind":"listed","path":"models/modeling_utils.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/models/modeling_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c499a6b2e9532db"}},{"code_sha256_prefix":"af7992ac4792655f","entry":"resnet_face18","repo":"idonahum/photoVerse","repo_kind":"listed","path":"models/arcface_resnet.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/models/arcface_resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af7992ac4792655f"}},{"code_sha256_prefix":"35ca8b80299da3c0","entry":"run_inference","repo":"idonahum/photoVerse","repo_kind":"listed","path":"models/infer.py","file_url":"https://github.com/idonahum/photoVerse/blob/HEAD/models/infer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35ca8b80299da3c0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}