{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/u-vap-user-specified-visual-appearance","title":"U-VAP: User-specified Visual Appearance Personalization via Decoupled Self Augmentation","arxiv_id":"2403.20231","date":"2024-03-29","proceeding":"CVPR 2024 1","authors":["You Wu","Kean Liu","Xiaoyue Mi","Fan Tang","Juan Cao","Jintao Li"],"abstract":"Concept personalization methods enable large text-to-image models to learn specific subjects (e.g., objects/poses/3D models) and synthesize renditions in new contexts. Given that the image references are highly biased towards visual attributes, state-of-the-art personalization models tend to overfit the whole subject and cannot disentangle visual characteristics in pixel space. In this study, we proposed a more challenging setting, namely fine-grained visual appearance personalization. Different from existing methods, we allow users to provide a sentence describing the desired attributes. A novel decoupled self-augmentation strategy is proposed to generate target-related and non-target samples to learn user-specified visual attributes. These augmented data allow for refining the model's understanding of the target attribute while mitigating the impact of unrelated attributes. At the inference stage, adjustments are conducted on semantic space through the learned target and non-target embeddings to further enhance the disentanglement of target attributes. Extensive experiments on various kinds of visual attributes with SOTA personalization methods show the ability of the proposed method to mimic target visual appearance in novel contexts, thus improving the controllability and flexibility of personalization.","url_abs":"https://arxiv.org/abs/2403.20231v1","url_pdf":"https://arxiv.org/pdf/2403.20231v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"u-vap-user-specified-visual-appearance","repo_url":"https://github.com/ictmcg/u-vap","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"disentanglement","task_name":"Disentanglement"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.20231","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.20231"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ictmcg/u-vap","reach":null}],"summary":{"ran":6,"ran_draft_wrong":1,"unverified":7},"by_repo_kind":{"official":{"samples":14,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"558cf5130888f74c","entry":"CLIPAttention","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"558cf5130888f74c"}},{"code_sha256_prefix":"58cc0dc08e1bb9df","entry":"CLIPOutput","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"58cc0dc08e1bb9df"}},{"code_sha256_prefix":"de79008ffa19d769","entry":"CLIPTextEmbeddings","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"de79008ffa19d769"}},{"code_sha256_prefix":"6b93811e04711dd2","entry":"CLIPTextModelOutput","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b93811e04711dd2"}},{"code_sha256_prefix":"4809414b75263882","entry":"CLIPVisionEmbeddings","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4809414b75263882"}},{"code_sha256_prefix":"c0b6d0381e9a60e0","entry":"CLIPVisionModelOutput","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c0b6d0381e9a60e0"}},{"code_sha256_prefix":"93c6887621a9f47c","entry":"_expand_mask","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"93c6887621a9f47c"}},{"code_sha256_prefix":"d6ac17c8ddf0f49b","entry":"CLIPEncoder","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d6ac17c8ddf0f49b"}},{"code_sha256_prefix":"6c4ad49ccd8cc6f5","entry":"CLIPEncoderLayer","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c4ad49ccd8cc6f5"}},{"code_sha256_prefix":"c00b70b4d395e15a","entry":"CLIPModel","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c00b70b4d395e15a"}},{"code_sha256_prefix":"0a76c5704ab25d88","entry":"CLIPTextModelWithProjection","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a76c5704ab25d88"}},{"code_sha256_prefix":"fdcf936fbb55bebb","entry":"CLIPTextTransformer","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fdcf936fbb55bebb"}},{"code_sha256_prefix":"a922142d0d657e31","entry":"CLIPVisionModelWithProjection","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a922142d0d657e31"}},{"code_sha256_prefix":"fa8af7191540e8ef","entry":"CLIPVisionTransformer","repo":"ictmcg/u-vap","repo_kind":"official","path":"models/modeling_clip.py","file_url":"https://github.com/ictmcg/u-vap/blob/HEAD/models/modeling_clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fa8af7191540e8ef"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}