{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/visual-autoregressive-modeling-for-image","title":"Visual Autoregressive Modeling for Image Super-Resolution","arxiv_id":"2501.18993","date":"2025-01-31","proceeding":null,"authors":["Yunpeng Qu","Kun Yuan","Jinhua Hao","Kai Zhao","Qizhi Xie","Ming Sun","Chao Zhou"],"abstract":"Image Super-Resolution (ISR) has seen significant progress with the introduction of remarkable generative models. However, challenges such as the trade-off issues between fidelity and realism, as well as computational complexity, have also posed limitations on their application. Building upon the tremendous success of autoregressive models in the language domain, we propose \\textbf{VARSR}, a novel visual autoregressive modeling for ISR framework with the form of next-scale prediction. To effectively integrate and preserve semantic information in low-resolution images, we propose using prefix tokens to incorporate the condition. Scale-aligned Rotary Positional Encodings are introduced to capture spatial structures and the diffusion refiner is utilized for modeling quantization residual loss to achieve pixel-level fidelity. Image-based Classifier-free Guidance is proposed to guide the generation of more realistic images. Furthermore, we collect large-scale data and design a training process to obtain robust generative priors. Quantitative and qualitative results show that VARSR is capable of generating high-fidelity and high-realism images with more efficiency than diffusion-based methods. Our codes will be released at https://github.com/qyp2000/VARSR.","url_abs":"https://arxiv.org/abs/2501.18993v1","url_pdf":"https://arxiv.org/pdf/2501.18993v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"visual-autoregressive-modeling-for-image","repo_url":"https://github.com/qyp2000/varsr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-super-resolution","task_name":"Image Super-Resolution"},{"task_slug":"quantization","task_name":"Quantization"},{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2501.18993","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2501.18993"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qyp2000/varsr","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran_fixture":1,"ran":2,"unverified":17},"by_repo_kind":{"official":{"samples":22,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9fcdaa6e423e8aa7","entry":"Normalize","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_vae.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9fcdaa6e423e8aa7"}},{"code_sha256_prefix":"971ae8d2d8313e30","entry":"drop_path","repo":"qyp2000/varsr","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"971ae8d2d8313e30"}},{"code_sha256_prefix":"e543491ea064c733","entry":"gumbel_softmax_with_rng","repo":"qyp2000/varsr","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e543491ea064c733"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_vae.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"80371584448f2f6e","entry":"sample_with_top_k_top_p_","repo":"qyp2000/varsr","repo_kind":"official","path":"models/helpers.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80371584448f2f6e"}},{"code_sha256_prefix":"e847ee15f089dee6","entry":"allgather","repo":"qyp2000/varsr","repo_kind":"official","path":"dist.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e847ee15f089dee6"}},{"code_sha256_prefix":"ff4c548fd07140d0","entry":"allreduce","repo":"qyp2000/varsr","repo_kind":"official","path":"dist.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff4c548fd07140d0"}},{"code_sha256_prefix":"fe05416387de89c6","entry":"g_path_regularize","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/gan_loss.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/gan_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fe05416387de89c6"}},{"code_sha256_prefix":"81eb425a41a7c2a1","entry":"gradient_penalty_loss","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/gan_loss.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/gan_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81eb425a41a7c2a1"}},{"code_sha256_prefix":"793c7e2489dd8dfc","entry":"make_attn","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_vae.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"793c7e2489dd8dfc"}},{"code_sha256_prefix":"794d4f7fc184e7e5","entry":"mesh_grid","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/degradations.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/degradations.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"794d4f7fc184e7e5"}},{"code_sha256_prefix":"826ea3fc406a6a09","entry":"new_group","repo":"qyp2000/varsr","repo_kind":"official","path":"dist.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"826ea3fc406a6a09"}},{"code_sha256_prefix":"321b9c73d589eb9e","entry":"pdf2","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/degradations.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/degradations.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"321b9c73d589eb9e"}},{"code_sha256_prefix":"a9b92fd04c7a2673","entry":"precompute_freqs_cis","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_var.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_var.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9b92fd04c7a2673"}},{"code_sha256_prefix":"06751eea9646054b","entry":"precompute_freqs_cis_cross","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_var.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_var.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06751eea9646054b"}},{"code_sha256_prefix":"309805bf14b604e0","entry":"precompute_freqs_cis_zeros","repo":"qyp2000/varsr","repo_kind":"official","path":"models/basic_var.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/basic_var.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"309805bf14b604e0"}},{"code_sha256_prefix":"c7cba9053f3cadb5","entry":"r1_penalty","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/gan_loss.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/gan_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7cba9053f3cadb5"}},{"code_sha256_prefix":"a648a03a952822c0","entry":"reduce_loss","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/loss_util.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/loss_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a648a03a952822c0"}},{"code_sha256_prefix":"e3444ff2b9d24600","entry":"sigma_matrix2","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/degradations.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/degradations.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3444ff2b9d24600"}},{"code_sha256_prefix":"1ba39317ea81871a","entry":"weight_reduce_loss","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/loss_util.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/loss_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ba39317ea81871a"}},{"code_sha256_prefix":"cf63f8afc13f62a7","entry":"weighted_loss","repo":"qyp2000/varsr","repo_kind":"official","path":"basicsr/losses/loss_util.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/basicsr/losses/loss_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf63f8afc13f62a7"}},{"code_sha256_prefix":"d81381b327c76edd","entry":"zero_module","repo":"qyp2000/varsr","repo_kind":"official","path":"models/var.py","file_url":"https://github.com/qyp2000/varsr/blob/HEAD/models/var.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d81381b327c76edd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}