{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/infinity-scaling-bitwise-autoregressive","title":"Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis","arxiv_id":"2412.04431","date":"2024-12-05","proceeding":"CVPR 2025 1","authors":["Jian Han","Jinlai Liu","Yi Jiang","Bin Yan","Yuqi Zhang","Zehuan Yuan","Bingyue Peng","Xiaobing Liu"],"abstract":"We present Infinity, a Bitwise Visual AutoRegressive Modeling capable of generating high-resolution, photorealistic images following language instruction. Infinity redefines visual autoregressive model under a bitwise token prediction framework with an infinite-vocabulary tokenizer & classifier and bitwise self-correction mechanism, remarkably improving the generation capacity and details. By theoretically scaling the tokenizer vocabulary size to infinity and concurrently scaling the transformer size, our method significantly unleashes powerful scaling capabilities compared to vanilla VAR. Infinity sets a new record for autoregressive text-to-image models, outperforming top-tier diffusion models like SD3-Medium and SDXL. Notably, Infinity surpasses SD3-Medium by improving the GenEval benchmark score from 0.62 to 0.73 and the ImageReward benchmark score from 0.87 to 0.96, achieving a win rate of 66%. Without extra optimization, Infinity generates a high-quality 1024x1024 image in 0.8 seconds, making it 2.6x faster than SD3-Medium and establishing it as the fastest text-to-image model. Models and codes will be released to promote further exploration of Infinity for visual generation and unified tokenizer modeling.","url_abs":"https://arxiv.org/abs/2412.04431v1","url_pdf":"https://arxiv.org/pdf/2412.04431v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"infinity-scaling-bitwise-autoregressive","repo_url":"https://github.com/FoundationVision/Infinity","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"infinity-scaling-bitwise-autoregressive","repo_url":"https://github.com/FoundationVision/VAR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2412.04431","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.04431"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/FoundationVision/Infinity","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/FoundationVision/VAR","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":5,"ran_violates":1,"ran_fixture":4,"ran":2,"unverified":7},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1},"listed":{"samples":12,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"9fcdaa6e423e8aa7","entry":"Normalize","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/basic_vae.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9fcdaa6e423e8aa7"}},{"code_sha256_prefix":"9e7e8cb16293d38e","entry":"aug_with_positive_prompt","repo":"FoundationVision/Infinity","repo_kind":"official","path":"tools/run_infinity.py","file_url":"https://github.com/FoundationVision/Infinity/blob/HEAD/tools/run_infinity.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e7e8cb16293d38e"}},{"code_sha256_prefix":"971ae8d2d8313e30","entry":"drop_path","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/helpers.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"971ae8d2d8313e30"}},{"code_sha256_prefix":"c490ce79bba70918","entry":"encode_prompt","repo":"FoundationVision/Infinity","repo_kind":"official","path":"tools/run_infinity.py","file_url":"https://github.com/FoundationVision/Infinity/blob/HEAD/tools/run_infinity.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c490ce79bba70918"}},{"code_sha256_prefix":"8535a42ccd56fce0","entry":"extract_key_val","repo":"FoundationVision/Infinity","repo_kind":"official","path":"tools/run_infinity.py","file_url":"https://github.com/FoundationVision/Infinity/blob/HEAD/tools/run_infinity.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8535a42ccd56fce0"}},{"code_sha256_prefix":"6a19741de3a68058","entry":"get_params_num","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"6a19741de3a68058"}},{"code_sha256_prefix":"e543491ea064c733","entry":"gumbel_softmax_with_rng","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/helpers.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e543491ea064c733"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/basic_vae.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"80371584448f2f6e","entry":"sample_with_top_k_top_p_","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/helpers.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/helpers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80371584448f2f6e"}},{"code_sha256_prefix":"9526ce09c7148703","entry":"sample_with_top_k_top_p_also_inplace_modifying_logits_","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"9526ce09c7148703"}},{"code_sha256_prefix":"5451c3f14c7e520c","entry":"sampling_with_top_k_top_p_also_inplace_modifying_probs_","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"5451c3f14c7e520c"}},{"code_sha256_prefix":"844a4aecea80d106","entry":"timed","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"844a4aecea80d106"}},{"code_sha256_prefix":"e847ee15f089dee6","entry":"allgather","repo":"FoundationVision/VAR","repo_kind":"listed","path":"dist.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e847ee15f089dee6"}},{"code_sha256_prefix":"ff4c548fd07140d0","entry":"allreduce","repo":"FoundationVision/VAR","repo_kind":"listed","path":"dist.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff4c548fd07140d0"}},{"code_sha256_prefix":"8ff7703f731423de","entry":"build_dataset","repo":"FoundationVision/VAR","repo_kind":"listed","path":"utils/data.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/utils/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ff7703f731423de"}},{"code_sha256_prefix":"793c7e2489dd8dfc","entry":"make_attn","repo":"FoundationVision/VAR","repo_kind":"listed","path":"models/basic_vae.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/models/basic_vae.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"793c7e2489dd8dfc"}},{"code_sha256_prefix":"826ea3fc406a6a09","entry":"new_group","repo":"FoundationVision/VAR","repo_kind":"listed","path":"dist.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/dist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"826ea3fc406a6a09"}},{"code_sha256_prefix":"eabecb1bb23906fe","entry":"normalize_01_into_pm1","repo":"FoundationVision/VAR","repo_kind":"listed","path":"utils/data.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/utils/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eabecb1bb23906fe"}},{"code_sha256_prefix":"b1714d4e3b7ac3b9","entry":"pil_loader","repo":"FoundationVision/VAR","repo_kind":"listed","path":"utils/data.py","file_url":"https://github.com/FoundationVision/VAR/blob/HEAD/utils/data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1714d4e3b7ac3b9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}