{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/accelerating-score-based-generative-models-1","title":"Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling","arxiv_id":"2207.02196","date":"2022-07-05","proceeding":null,"authors":["Hengyuan Ma","Li Zhang","Xiatian Zhu","Jianfeng Feng"],"abstract":"Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential computations. An intuitive acceleration method is to reduce the sampling iterations which however causes severe performance degradation. We investigate this problem by viewing the diffusion sampling process as a Metropolis adjusted Langevin algorithm, which helps reveal the underlying cause to be ill-conditioned curvature. Under this insight, we propose a model-agnostic preconditioned diffusion sampling (PDS) method that leverages matrix preconditioning to alleviate the aforementioned problem. Crucially, PDS is proven theoretically to converge to the original target distribution of a SGM, no need for retraining. Extensive experiments on three image datasets with a variety of resolutions and diversity validate that PDS consistently accelerates off-the-shelf SGMs whilst maintaining the synthesis quality. In particular, PDS can accelerate by up to 29x on more challenging high resolution (1024x1024) image generation.","url_abs":"https://arxiv.org/abs/2207.02196v4","url_pdf":"https://arxiv.org/pdf/2207.02196v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"accelerating-score-based-generative-models-1","repo_url":"https://github.com/fudan-zvg/pds","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"image-generation","task_name":"Image Generation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2207.02196","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.02196"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fudan-zvg/pds","reach":null}],"summary":{"ran":2,"ran_draft_wrong":3,"unverified":4},"by_repo_kind":{"official":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a47db0e7a2395534","entry":"NoneCorrector","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a47db0e7a2395534"}},{"code_sha256_prefix":"38de9882d8ed3be3","entry":"NonePredictor","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38de9882d8ed3be3"}},{"code_sha256_prefix":"5df6dcb7a359ac39","entry":"dft2d","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5df6dcb7a359ac39"}},{"code_sha256_prefix":"30c016ba85e5c3ba","entry":"get_pc_sampler","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30c016ba85e5c3ba"}},{"code_sha256_prefix":"d1f7b1355cac7b94","entry":"idft2d","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d1f7b1355cac7b94"}},{"code_sha256_prefix":"8b4d3dbe438a7256","entry":"Corrector","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b4d3dbe438a7256"}},{"code_sha256_prefix":"ccb989dac7906e74","entry":"Predictor","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ccb989dac7906e74"}},{"code_sha256_prefix":"ce9148fdfa6ee740","entry":"shared_corrector_update_fn","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce9148fdfa6ee740"}},{"code_sha256_prefix":"0a6fc1e303e70fac","entry":"shared_predictor_update_fn","repo":"fudan-zvg/pds","repo_kind":"official","path":"sampling.py","file_url":"https://github.com/fudan-zvg/pds/blob/HEAD/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a6fc1e303e70fac"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}