{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/complexity-experts-are-task-discriminative","title":"Complexity Experts are Task-Discriminative Learners for Any Image Restoration","arxiv_id":"2411.18466","date":"2024-11-27","proceeding":"CVPR 2025 1","authors":["Eduard Zamfir","Zongwei Wu","Nancy Mehta","Yuedong Tan","Danda Pani Paudel","Yulun Zhang","Radu Timofte"],"abstract":"Recent advancements in all-in-one image restoration models have revolutionized the ability to address diverse degradations through a unified framework. However, parameters tied to specific tasks often remain inactive for other tasks, making mixture-of-experts (MoE) architectures a natural extension. Despite this, MoEs often show inconsistent behavior, with some experts unexpectedly generalizing across tasks while others struggle within their intended scope. This hinders leveraging MoEs' computational benefits by bypassing irrelevant experts during inference. We attribute this undesired behavior to the uniform and rigid architecture of traditional MoEs. To address this, we introduce ``complexity experts\" -- flexible expert blocks with varying computational complexity and receptive fields. A key challenge is assigning tasks to each expert, as degradation complexity is unknown in advance. Thus, we execute tasks with a simple bias toward lower complexity. To our surprise, this preference effectively drives task-specific allocation, assigning tasks to experts with the appropriate complexity. Extensive experiments validate our approach, demonstrating the ability to bypass irrelevant experts during inference while maintaining superior performance. The proposed MoCE-IR model outperforms state-of-the-art methods, affirming its efficiency and practical applicability. The source will be publicly made available at \\href{https://eduardzamfir.github.io/moceir/}{\\texttt{eduardzamfir.github.io/MoCE-IR/}}","url_abs":"https://arxiv.org/abs/2411.18466v1","url_pdf":"https://arxiv.org/pdf/2411.18466v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"blind-all-in-one-image-restoration","task_name":"Blind All-in-One Image Restoration"},{"task_slug":"image-restoration","task_name":"Image Restoration"},{"task_slug":"mixture-of-experts","task_name":"Mixture-of-Experts"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/blind-all-in-one-image-restoration-on-3","task":"Blind All-in-One Image Restoration","dataset":"3-Degradations","model":"MoCE-IR","rank_in_archive_order":2,"of":9,"metrics":{"Average PSNR":"32.73","SSIM":"0.917"},"uses_additional_data":false},{"leaderboard":"/sota/blind-all-in-one-image-restoration-on-5","task":"Blind All-in-One Image Restoration","dataset":"5-Degradations","model":"MoCE-IR","rank_in_archive_order":2,"of":9,"metrics":{"Average PSNR":"30.58","SSIM":"0.919"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2411.18466","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}