{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mvgamba-unify-3d-content-generation-as-state","title":"MVGamba: Unify 3D Content Generation as State Space Sequence Modeling","arxiv_id":"2406.06367","date":"2024-06-10","proceeding":null,"authors":["Xuanyu Yi","Zike Wu","Qiuhong Shen","Qingshan Xu","Pan Zhou","Joo-Hwee Lim","Shuicheng Yan","Xinchao Wang","Hanwang Zhang"],"abstract":"Recent 3D large reconstruction models (LRMs) can generate high-quality 3D content in sub-seconds by integrating multi-view diffusion models with scalable multi-view reconstructors. Current works further leverage 3D Gaussian Splatting as 3D representation for improved visual quality and rendering efficiency. However, we observe that existing Gaussian reconstruction models often suffer from multi-view inconsistency and blurred textures. We attribute this to the compromise of multi-view information propagation in favor of adopting powerful yet computationally intensive architectures (e.g., Transformers). To address this issue, we introduce MVGamba, a general and lightweight Gaussian reconstruction model featuring a multi-view Gaussian reconstructor based on the RNN-like State Space Model (SSM). Our Gaussian reconstructor propagates causal context containing multi-view information for cross-view self-refinement while generating a long sequence of Gaussians for fine-detail modeling with linear complexity. With off-the-shelf multi-view diffusion models integrated, MVGamba unifies 3D generation tasks from a single image, sparse images, or text prompts. Extensive experiments demonstrate that MVGamba outperforms state-of-the-art baselines in all 3D content generation scenarios with approximately only $0.1\\times$ of the model size.","url_abs":"https://arxiv.org/abs/2406.06367v3","url_pdf":"https://arxiv.org/pdf/2406.06367v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mvgamba-unify-3d-content-generation-as-state","repo_url":"https://github.com/skyworkai/mvgamba","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok"}},{"paper_slug":"mvgamba-unify-3d-content-generation-as-state","repo_url":"https://github.com/SkyworkAI/Gamba","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok"}}],"tasks":[{"task_slug":"3d-generation","task_name":"3D Generation"},{"task_slug":"attribute","task_name":"Attribute"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.06367","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.06367"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SkyworkAI/Gamba","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/skyworkai/mvgamba","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1},"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"d08df65a8e330a3b","entry":"check_tar_integrity","repo":"SkyworkAI/Gamba","repo_kind":"listed","path":"core/provider_ikun.py","file_url":"https://github.com/SkyworkAI/Gamba/blob/HEAD/core/provider_ikun.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d08df65a8e330a3b"}},{"code_sha256_prefix":"807e057029e98578","entry":"grid_distortion","repo":"SkyworkAI/Gamba","repo_kind":"listed","path":"core/utils.py","file_url":"https://github.com/SkyworkAI/Gamba/blob/HEAD/core/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"807e057029e98578"}},{"code_sha256_prefix":"3db568bd0931a81a","entry":"is_directory","repo":"SkyworkAI/Gamba","repo_kind":"listed","path":"core/data_check.py","file_url":"https://github.com/SkyworkAI/Gamba/blob/HEAD/core/data_check.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3db568bd0931a81a"}},{"code_sha256_prefix":"ff85614a09719ef0","entry":"reorder_tokens","repo":"skyworkai/mvgamba","repo_kind":"official","path":"core/gambaformer.py","file_url":"https://github.com/skyworkai/mvgamba/blob/HEAD/core/gambaformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff85614a09719ef0"}},{"code_sha256_prefix":"ab7645882d8b3d80","entry":"rotate_blocks_pytorch_for_loop","repo":"skyworkai/mvgamba","repo_kind":"official","path":"core/gambaformer.py","file_url":"https://github.com/skyworkai/mvgamba/blob/HEAD/core/gambaformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ab7645882d8b3d80"}},{"code_sha256_prefix":"aec6106be736cc4f","entry":"timestep_embedding","repo":"skyworkai/mvgamba","repo_kind":"official","path":"mvdream/mv_unet.py","file_url":"https://github.com/skyworkai/mvgamba/blob/HEAD/mvdream/mv_unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aec6106be736cc4f"}},{"code_sha256_prefix":"129b804760b3115f","entry":"zero_module","repo":"skyworkai/mvgamba","repo_kind":"official","path":"mvdream/mv_unet.py","file_url":"https://github.com/skyworkai/mvgamba/blob/HEAD/mvdream/mv_unet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"129b804760b3115f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}