{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/principled-probabilistic-imaging-using","title":"Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors","arxiv_id":"2405.18782","date":"2024-05-29","proceeding":null,"authors":["Zihui Wu","Yu Sun","Yifan Chen","Bingliang Zhang","Yisong Yue","Katherine L. Bouman"],"abstract":"Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on approximations in the generative process to be generic to different inverse problems, leading to inaccurate sample distributions that deviate from the target posterior defined within the Bayesian framework. To harness the generative power of DMs while avoiding such approximations, we propose a Markov chain Monte Carlo algorithm that performs posterior sampling for general inverse problems by reducing it to sampling the posterior of a Gaussian denoising problem. Crucially, we leverage a general DM formulation as a unified interface that allows for rigorously solving the denoising problem with a range of state-of-the-art DMs. We demonstrate the effectiveness of the proposed method on six inverse problems (three linear and three nonlinear), including a real-world black hole imaging problem. Experimental results indicate that our proposed method offers more accurate reconstructions and posterior estimation compared to existing DM-based imaging inverse methods.","url_abs":"https://arxiv.org/abs/2405.18782v2","url_pdf":"https://arxiv.org/pdf/2405.18782v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"principled-probabilistic-imaging-using","repo_url":"https://github.com/zihuiwu/PnP-DM-public","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-deblurring","task_name":"Image Deblurring"},{"task_slug":"image-super-resolution","task_name":"Image Super-Resolution"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2405.18782","atlas_url":"https://app.syntology.ai/?focus=2405.18782","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.18782"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zihuiwu/PnP-DM-public","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":8,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e41367ad14ff58fd","entry":"get_param_groups_and_shapes","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/fp16_util.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e41367ad14ff58fd"}},{"code_sha256_prefix":"27ade2bc91298c8a","entry":"load_yaml","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/edm/edm.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/edm/edm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"27ade2bc91298c8a"}},{"code_sha256_prefix":"e20dd5102da3b050","entry":"make_master_params","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/fp16_util.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e20dd5102da3b050"}},{"code_sha256_prefix":"64fff1e30802b815","entry":"unflatten_master_params","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/fp16_util.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64fff1e30802b815"}},{"code_sha256_prefix":"129b804760b3115f","entry":"zero_module","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/nn.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/nn.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"129b804760b3115f"}},{"code_sha256_prefix":"ecd0fc28815b65ae","entry":"avg_pool_nd","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/nn.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ecd0fc28815b65ae"}},{"code_sha256_prefix":"fe4eb545bbb728e0","entry":"conv_nd","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/nn.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fe4eb545bbb728e0"}},{"code_sha256_prefix":"17385f7e7086e595","entry":"create_unet_adm","repo":"zihuiwu/PnP-DM-public","repo_kind":"official","path":"pnpdm/models/unet_adm/unet_adm.py","file_url":"https://github.com/zihuiwu/PnP-DM-public/blob/HEAD/pnpdm/models/unet_adm/unet_adm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17385f7e7086e595"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}