{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/physics3d-learning-physical-properties-of-3d","title":"Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion","arxiv_id":"2406.04338","date":"2024-06-06","proceeding":null,"authors":["Fangfu Liu","HanYang Wang","Shunyu Yao","Shengjun Zhang","Jie zhou","Yueqi Duan"],"abstract":"In recent years, there has been rapid development in 3D generation models, opening up new possibilities for applications such as simulating the dynamic movements of 3D objects and customizing their behaviors. However, current 3D generative models tend to focus only on surface features such as color and shape, neglecting the inherent physical properties that govern the behavior of objects in the real world. To accurately simulate physics-aligned dynamics, it is essential to predict the physical properties of materials and incorporate them into the behavior prediction process. Nonetheless, predicting the diverse materials of real-world objects is still challenging due to the complex nature of their physical attributes. In this paper, we propose \\textbf{Physics3D}, a novel method for learning various physical properties of 3D objects through a video diffusion model. Our approach involves designing a highly generalizable physical simulation system based on a viscoelastic material model, which enables us to simulate a wide range of materials with high-fidelity capabilities. Moreover, we distill the physical priors from a video diffusion model that contains more understanding of realistic object materials. Extensive experiments demonstrate the effectiveness of our method with both elastic and plastic materials. Physics3D shows great potential for bridging the gap between the physical world and virtual neural space, providing a better integration and application of realistic physical principles in virtual environments. Project page: https://liuff19.github.io/Physics3D.","url_abs":"https://arxiv.org/abs/2406.04338v3","url_pdf":"https://arxiv.org/pdf/2406.04338v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"physics3d-learning-physical-properties-of-3d","repo_url":"https://github.com/liuff19/physics3d","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-generation","task_name":"3D Generation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.04338","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.04338"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/liuff19/physics3d","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"unverified":7},"by_repo_kind":{"listed":{"samples":8,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ddd567b7a94424d3","entry":"generate_local_coord","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/camera_view_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/camera_view_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ddd567b7a94424d3"}},{"code_sha256_prefix":"d35b2c392fc4224e","entry":"C","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/threestudio_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/threestudio_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d35b2c392fc4224e"}},{"code_sha256_prefix":"43490c98175d772f","entry":"decode_param_json","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/decode_param.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/decode_param.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43490c98175d772f"}},{"code_sha256_prefix":"0554248af1b5ef2f","entry":"find_far_points","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/decode_param.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/decode_param.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0554248af1b5ef2f"}},{"code_sha256_prefix":"2b9cf8baab6bc8b4","entry":"generate_camera_rotation_matrix","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/camera_view_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/camera_view_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b9cf8baab6bc8b4"}},{"code_sha256_prefix":"fc9200f0d0d5f797","entry":"get_point_on_sphere","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/camera_view_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/camera_view_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc9200f0d0d5f797"}},{"code_sha256_prefix":"6af3c658eeadc4ad","entry":"parse_version","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/threestudio_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/threestudio_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6af3c658eeadc4ad"}},{"code_sha256_prefix":"6295df114ab36436","entry":"shifted_expotional_decay","repo":"liuff19/physics3d","repo_kind":"listed","path":"utils/threestudio_utils.py","file_url":"https://github.com/liuff19/physics3d/blob/HEAD/utils/threestudio_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6295df114ab36436"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}