{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2508-15772","title":"Visual Autoregressive Modeling for Instruction-Guided Image Editing","arxiv_id":"2508.15772","date":"2025-08-21","proceeding":"ICLR","authors":["Qingyang Mao","Qi Cai","Yehao Li","Yingwei Pan","Mingyue Cheng","Ting Yao","Qi Liu","Tao Mei"],"abstract":"Recent advances in diffusion models have brought remarkable visual fidelity to instruction-guided image editing. However, their global denoising process inherently entangles the edited region with the entire image context, leading to unintended spurious modifications and compromised adherence to editing instructions. In contrast, autoregressive models offer a distinct paradigm by formulating image synthesis as a sequential process over discrete visual tokens. Their causal and compositional mechanism naturally circumvents the adherence challenges of diffusion-based methods. In this paper, we present VAREdit, a visual autoregressive (VAR) framework that reframes image editing as a next-scale prediction problem. Conditioned on source image features and text instructions, VAREdit generates multi-scale target features to achieve precise edits. A core challenge in this paradigm is how to effectively condition the source image tokens. We observe that finest-scale source features cannot effectively guide the prediction of coarser target features. To bridge this gap, we introduce a Scale-Aligned Reference (SAR) module, which injects scale-matched conditioning information into the first self-attention layer. VAREdit demonstrates significant advancements in both editing adherence and efficiency. On EMU-Edit and PIE-Bench benchmarks, VAREdit outperforms leading diffusion-based methods by a substantial margin in terms of both CLIP and GPT scores. Moreover, VAREdit completes a 512$\\times$512 editing in 1.2 seconds, making it 2.2$\\times$ faster than the similarly sized UltraEdit. Code is available at: https://github.com/HiDream-ai/VAREdit.","url_abs":"https://arxiv.org/abs/2508.15772","url_pdf":"https://arxiv.org/pdf/2508.15772","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2508.15772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2508.15772"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/HiDream-ai/VAREdit","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"ran_draft_wrong":1,"ran_fixture":2,"unverified":12},"by_repo_kind":{"found_in_text":{"samples":17,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b4a8295838aac5c1","entry":"get_dropout_layer","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/basic.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/basic.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4a8295838aac5c1"}},{"code_sha256_prefix":"2d0f2338dbaba23b","entry":"get_ema_model","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/ema.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/ema.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d0f2338dbaba23b"}},{"code_sha256_prefix":"6a19741de3a68058","entry":"get_params_num","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/infinity.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/infinity.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a19741de3a68058"}},{"code_sha256_prefix":"9526ce09c7148703","entry":"sample_with_top_k_top_p_also_inplace_modifying_logits_","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/infinity.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/infinity.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9526ce09c7148703"}},{"code_sha256_prefix":"5451c3f14c7e520c","entry":"sampling_with_top_k_top_p_also_inplace_modifying_probs_","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/infinity.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/infinity.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5451c3f14c7e520c"}},{"code_sha256_prefix":"ae628f6f7137682b","entry":"apply_rotary_emb","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/basic.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/basic.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae628f6f7137682b"}},{"code_sha256_prefix":"741564849ed1a76c","entry":"denormalize_pm1_into_01","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/dataset/build.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/dataset/build.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"741564849ed1a76c"}},{"code_sha256_prefix":"0a9d5c3882889998","entry":"features2image","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/bitwise_self_correction.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/bitwise_self_correction.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a9d5c3882889998"}},{"code_sha256_prefix":"2c95f490aca10ca4","entry":"fused_ada_layer_norm","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/fused_op.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/fused_op.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c95f490aca10ca4"}},{"code_sha256_prefix":"2799799371543095","entry":"fused_ada_rms_norm","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/fused_op.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/fused_op.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2799799371543095"}},{"code_sha256_prefix":"6c1bfd60f7bf3664","entry":"fused_rms_norm","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/fused_op.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/fused_op.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c1bfd60f7bf3664"}},{"code_sha256_prefix":"9ba6c0e0e8e4e50e","entry":"labels2image","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/bitwise_self_correction.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/bitwise_self_correction.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ba6c0e0e8e4e50e"}},{"code_sha256_prefix":"eabecb1bb23906fe","entry":"normalize_01_into_pm1","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/dataset/build.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/dataset/build.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eabecb1bb23906fe"}},{"code_sha256_prefix":"8115343c78f1f050","entry":"pad_image_to_square","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/dataset/webdataset.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/dataset/webdataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8115343c78f1f050"}},{"code_sha256_prefix":"c99fb8b2d71c7fd2","entry":"precompute_rope2d_freqs_grid","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/models/basic.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/models/basic.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c99fb8b2d71c7fd2"}},{"code_sha256_prefix":"2ee529509f3e71b8","entry":"transform","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infer.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ee529509f3e71b8"}},{"code_sha256_prefix":"218e5b39b233e615","entry":"transform","repo":"HiDream-ai/VAREdit","repo_kind":"found_in_text","path":"infinity/dataset/webdataset.py","file_url":"https://github.com/HiDream-ai/VAREdit/blob/HEAD/infinity/dataset/webdataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"218e5b39b233e615"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}