{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/stylerdalle-language-guided-style-transfer","title":"StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model","arxiv_id":"2303.09268","date":"2023-03-16","proceeding":"ICCV 2023 1","authors":["Zipeng Xu","Enver Sangineto","Nicu Sebe"],"abstract":"Despite the progress made in the style transfer task, most previous work focus on transferring only relatively simple features like color or texture, while missing more abstract concepts such as overall art expression or painter-specific traits. However, these abstract semantics can be captured by models like DALL-E or CLIP, which have been trained using huge datasets of images and textual documents. In this paper, we propose StylerDALLE, a style transfer method that exploits both of these models and uses natural language to describe abstract art styles. Specifically, we formulate the language-guided style transfer task as a non-autoregressive token sequence translation, i.e., from input content image to output stylized image, in the discrete latent space of a large-scale pretrained vector-quantized tokenizer, e.g., the discrete variational auto-encoder (dVAE) of DALL-E. To incorporate style information, we propose a Reinforcement Learning strategy with CLIP-based language supervision that ensures stylization and content preservation simultaneously. Experimental results demonstrate the superiority of our method, which can effectively transfer art styles using language instructions at different granularities. Code is available at https://github.com/zipengxuc/StylerDALLE.","url_abs":"https://arxiv.org/abs/2303.09268v2","url_pdf":"https://arxiv.org/pdf/2303.09268v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stylerdalle-language-guided-style-transfer","repo_url":"https://github.com/zipengxuc/stylerdalle","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"style-transfer","task_name":"Style Transfer"}],"methods":[{"method_slug":"clip","method_name":"CLIP"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.09268","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.09268"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zipengxuc/stylerdalle","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/zipengxuc/StylerDALLE","reach":{"status":"ok"}}],"summary":{"ran":9,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"027fa26affff0edf","entry":"MlpTransformer","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"027fa26affff0edf"}},{"code_sha256_prefix":"2dc27bff063bb4e6","entry":"MultiHeadAttention","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2dc27bff063bb4e6"}},{"code_sha256_prefix":"2b43915dfaf9b7ef","entry":"MultiHeadAttentionQKV","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2b43915dfaf9b7ef"}},{"code_sha256_prefix":"ec73607249e7849c","entry":"NATransformerPos","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ec73607249e7849c"}},{"code_sha256_prefix":"5d401edbcd509775","entry":"PositionEmbeddingLearned","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d401edbcd509775"}},{"code_sha256_prefix":"ecbe5a24398189f0","entry":"TransformerAddPos","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ecbe5a24398189f0"}},{"code_sha256_prefix":"0d8a8105c0e3bfb0","entry":"TransformerLayer","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d8a8105c0e3bfb0"}},{"code_sha256_prefix":"7289a2699481be38","entry":"TransformerLayerQKV","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7289a2699481be38"}},{"code_sha256_prefix":"f6a86586b4628fb9","entry":"TransformerPos","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f6a86586b4628fb9"}},{"code_sha256_prefix":"91280f70dc59ab16","entry":"StylerDALLEModel","repo":"zipengxuc/StylerDALLE","repo_kind":"official","path":"module.py","file_url":"https://github.com/zipengxuc/StylerDALLE/blob/HEAD/module.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"91280f70dc59ab16"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}