{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hierarchical-integration-diffusion-model-for-1","title":"Hierarchical Integration Diffusion Model for Realistic Image Deblurring","arxiv_id":"2305.12966","date":"2023-05-22","proceeding":"NeurIPS 2023 11","authors":["Zheng Chen","Yulun Zhang","Ding Liu","Bin Xia","Jinjin Gu","Linghe Kong","Xin Yuan"],"abstract":"Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to recover the clean image from pure Gaussian noise, which consumes massive computational resources. Moreover, the distribution synthesized by the diffusion model is often misaligned with the target results, leading to restrictions in distortion-based metrics. To address the above issues, we propose the Hierarchical Integration Diffusion Model (HI-Diff), for realistic image deblurring. Specifically, we perform the DM in a highly compacted latent space to generate the prior feature for the deblurring process. The deblurring process is implemented by a regression-based method to obtain better distortion accuracy. Meanwhile, the highly compact latent space ensures the efficiency of the DM. Furthermore, we design the hierarchical integration module to fuse the prior into the regression-based model from multiple scales, enabling better generalization in complex blurry scenarios. Comprehensive experiments on synthetic and real-world blur datasets demonstrate that our HI-Diff outperforms state-of-the-art methods. Code and trained models are available at https://github.com/zhengchen1999/HI-Diff.","url_abs":"https://arxiv.org/abs/2305.12966v4","url_pdf":"https://arxiv.org/pdf/2305.12966v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hierarchical-integration-diffusion-model-for-1","repo_url":"https://github.com/zhengchen1999/hi-diff","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"deblurring","task_name":"Deblurring"},{"task_slug":"image-deblurring","task_name":"Image Deblurring"},{"task_slug":"model","task_name":"model"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2305.12966","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.12966"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/zhengchen1999/HI-Diff","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhengchen1999/hi-diff","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":4,"ran_violates":2,"ran_fixture":2,"unverified":5},"by_repo_kind":{"official":{"samples":13,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"91fa50e293bf2fde","entry":"compute_psnr","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"evaluate_realblur.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/evaluate_realblur.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"91fa50e293bf2fde"}},{"code_sha256_prefix":"fbf9ec7be545688e","entry":"default","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/beta_schedule.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/beta_schedule.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fbf9ec7be545688e"}},{"code_sha256_prefix":"769e9c110eeb4a0d","entry":"dict2str","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/options.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/options.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"769e9c110eeb4a0d"}},{"code_sha256_prefix":"608e364a9d2376a3","entry":"exists","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/beta_schedule.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/beta_schedule.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"608e364a9d2376a3"}},{"code_sha256_prefix":"cd569444547de84f","entry":"get_position_from_periods","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/lr_scheduler.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/lr_scheduler.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cd569444547de84f"}},{"code_sha256_prefix":"78feb2965623416b","entry":"make_beta_schedule","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/beta_schedule.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/beta_schedule.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"78feb2965623416b"}},{"code_sha256_prefix":"82a15cc1e46f7e4d","entry":"to_3d","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/archs/Transformer_arch.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/archs/Transformer_arch.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"82a15cc1e46f7e4d"}},{"code_sha256_prefix":"b20f2a5df739a59e","entry":"to_4d","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/archs/Transformer_arch.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/archs/Transformer_arch.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b20f2a5df739a59e"}},{"code_sha256_prefix":"7f124cd33fb750ee","entry":"augment","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/transforms.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/transforms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7f124cd33fb750ee"}},{"code_sha256_prefix":"64c776bb050ba1e2","entry":"compute_ssim","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"evaluate_realblur.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/evaluate_realblur.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"64c776bb050ba1e2"}},{"code_sha256_prefix":"5aad1c1e328fd4ec","entry":"image_align","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"evaluate_realblur.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/evaluate_realblur.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5aad1c1e328fd4ec"}},{"code_sha256_prefix":"223d0788b0725dfb","entry":"mod_crop","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/transforms.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/transforms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"223d0788b0725dfb"}},{"code_sha256_prefix":"64cd160c586b1bef","entry":"paired_random_crop","repo":"zhengchen1999/HI-Diff","repo_kind":"official","path":"hi_diff/utils/transforms.py","file_url":"https://github.com/zhengchen1999/HI-Diff/blob/HEAD/hi_diff/utils/transforms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"64cd160c586b1bef"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}