{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deep-reparametrization-of-multi-frame-super","title":"Deep Reparametrization of Multi-Frame Super-Resolution and Denoising","arxiv_id":"2108.08286","date":"2021-08-18","proceeding":"ICCV 2021 10","authors":["Goutam Bhat","Martin Danelljan","Fisher Yu","Luc van Gool","Radu Timofte"],"abstract":"We propose a deep reparametrization of the maximum a posteriori formulation commonly employed in multi-frame image restoration tasks. Our approach is derived by introducing a learned error metric and a latent representation of the target image, which transforms the MAP objective to a deep feature space. The deep reparametrization allows us to directly model the image formation process in the latent space, and to integrate learned image priors into the prediction. Our approach thereby leverages the advantages of deep learning, while also benefiting from the principled multi-frame fusion provided by the classical MAP formulation. We validate our approach through comprehensive experiments on burst denoising and burst super-resolution datasets. Our approach sets a new state-of-the-art for both tasks, demonstrating the generality and effectiveness of the proposed formulation.","url_abs":"https://arxiv.org/abs/2108.08286v1","url_pdf":"https://arxiv.org/pdf/2108.08286v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-reparametrization-of-multi-frame-super","repo_url":"https://github.com/goutamgmb/deep-burst-sr","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"deep-reparametrization-of-multi-frame-super","repo_url":"https://github.com/goutamgmb/deep-rep","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"burst-image-super-resolution","task_name":"Burst Image Super-Resolution"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"image-restoration","task_name":"Image Restoration"},{"task_slug":"multi-frame-super-resolution","task_name":"Multi-Frame Super-Resolution"},{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/burst-image-super-resolution-on-burstsr","task":"Burst Image Super-Resolution","dataset":"BurstSR","model":"MFIR","rank_in_archive_order":6,"of":9,"metrics":{"LPIPS":"0.023","PSNR":"48.33","SSIM":"0.985"},"uses_additional_data":false},{"leaderboard":"/sota/burst-image-super-resolution-on","task":"Burst Image Super-Resolution","dataset":"SyntheticBurst","model":"MFIR","rank_in_archive_order":7,"of":8,"metrics":{"LPIPS":"0.045","PSNR":"41.56","SSIM":"0.964"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2108.08286","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}