{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/flexvar-flexible-visual-autoregressive","title":"FlexVAR: Flexible Visual Autoregressive Modeling without Residual Prediction","arxiv_id":"2502.20313","date":"2025-02-27","proceeding":null,"authors":["Siyu Jiao","Gengwei Zhang","Yinlong Qian","Jiancheng Huang","Yao Zhao","Humphrey Shi","Lin Ma","Yunchao Wei","Zequn Jie"],"abstract":"This work challenges the residual prediction paradigm in visual autoregressive modeling and presents FlexVAR, a new Flexible Visual AutoRegressive image generation paradigm. FlexVAR facilitates autoregressive learning with ground-truth prediction, enabling each step to independently produce plausible images. This simple, intuitive approach swiftly learns visual distributions and makes the generation process more flexible and adaptable. Trained solely on low-resolution images ($\\leq$ 256px), FlexVAR can: (1) Generate images of various resolutions and aspect ratios, even exceeding the resolution of the training images. (2) Support various image-to-image tasks, including image refinement, in/out-painting, and image expansion. (3) Adapt to various autoregressive steps, allowing for faster inference with fewer steps or enhancing image quality with more steps. Our 1.0B model outperforms its VAR counterpart on the ImageNet 256$\\times$256 benchmark. Moreover, when zero-shot transfer the image generation process with 13 steps, the performance further improves to 2.08 FID, outperforming state-of-the-art autoregressive models AiM/VAR by 0.25/0.28 FID and popular diffusion models LDM/DiT by 1.52/0.19 FID, respectively. When transferring our 1.0B model to the ImageNet 512$\\times$512 benchmark in a zero-shot manner, FlexVAR achieves competitive results compared to the VAR 2.3B model, which is a fully supervised model trained at 512$\\times$512 resolution.","url_abs":"https://arxiv.org/abs/2502.20313v1","url_pdf":"https://arxiv.org/pdf/2502.20313v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"flexvar-flexible-visual-autoregressive","repo_url":"https://github.com/jiaosiyu1999/FlexVAR","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"prediction","task_name":"Prediction"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2502.20313","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2502.20313"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jiaosiyu1999/FlexVAR","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":3,"ran_fixture":2,"ran":2,"unverified":5},"by_repo_kind":{"official":{"samples":12,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"01b5cf639b6bac89","entry":"Normalize","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/vq_llama.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/vq_llama.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"01b5cf639b6bac89"}},{"code_sha256_prefix":"1712a07966b542ee","entry":"center_crop_arr","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dataset/augmentation.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dataset/augmentation.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1712a07966b542ee"}},{"code_sha256_prefix":"774c95b77d7621f3","entry":"compute_entropy_loss","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/vq_llama.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/vq_llama.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"774c95b77d7621f3"}},{"code_sha256_prefix":"971ae8d2d8313e30","entry":"drop_path","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"971ae8d2d8313e30"}},{"code_sha256_prefix":"e543491ea064c733","entry":"gumbel_softmax_with_rng","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e543491ea064c733"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/vq_llama.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/vq_llama.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"80371584448f2f6e","entry":"sample_with_top_k_top_p_","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80371584448f2f6e"}},{"code_sha256_prefix":"e847ee15f089dee6","entry":"allgather","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dist.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e847ee15f089dee6"}},{"code_sha256_prefix":"ff4c548fd07140d0","entry":"allreduce","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dist.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff4c548fd07140d0"}},{"code_sha256_prefix":"0a65aaf586d4f90b","entry":"build_openimage","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dataset/openimage.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dataset/openimage.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a65aaf586d4f90b"}},{"code_sha256_prefix":"826ea3fc406a6a09","entry":"new_group","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dist.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"826ea3fc406a6a09"}},{"code_sha256_prefix":"5c39d5cf4b4b2a41","entry":"random_crop_arr","repo":"jiaosiyu1999/FlexVAR","repo_kind":"official","path":"dataset/augmentation.py","file_url":"https://github.com/jiaosiyu1999/FlexVAR/blob/HEAD/dataset/augmentation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5c39d5cf4b4b2a41"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}