{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/real-time-user-guided-image-colorization-with","title":"Real-Time User-Guided Image Colorization with Learned Deep Priors","arxiv_id":"1705.02999","date":"2017-05-08","proceeding":null,"authors":["Richard Zhang","Jun-Yan Zhu","Phillip Isola","Xinyang Geng","Angela S. Lin","Tianhe Yu","Alexei A. Efros"],"abstract":"We propose a deep learning approach for user-guided image colorization. The\nsystem directly maps a grayscale image, along with sparse, local user \"hints\"\nto an output colorization with a Convolutional Neural Network (CNN). Rather\nthan using hand-defined rules, the network propagates user edits by fusing\nlow-level cues along with high-level semantic information, learned from\nlarge-scale data. We train on a million images, with simulated user inputs. To\nguide the user towards efficient input selection, the system recommends likely\ncolors based on the input image and current user inputs. The colorization is\nperformed in a single feed-forward pass, enabling real-time use. Even with\nrandomly simulated user inputs, we show that the proposed system helps novice\nusers quickly create realistic colorizations, and offers large improvements in\ncolorization quality with just a minute of use. In addition, we demonstrate\nthat the framework can incorporate other user \"hints\" to the desired\ncolorization, showing an application to color histogram transfer. Our code and\nmodels are available at https://richzhang.github.io/ideepcolor.","url_abs":"http://arxiv.org/abs/1705.02999v1","url_pdf":"http://arxiv.org/pdf/1705.02999v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"real-time-user-guided-image-colorization-with","repo_url":"https://github.com/junyanz/interactive-deep-colorization","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"real-time-user-guided-image-colorization-with","repo_url":"https://github.com/CocoSungMin/Gachon_SW_Colorization_Contest","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"real-time-user-guided-image-colorization-with","repo_url":"https://github.com/kritiksoman/GIMP-ML","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"colorization","task_name":"Colorization"},{"task_slug":"image-colorization","task_name":"Image Colorization"},{"task_slug":"point-interactive-image-colorization","task_name":"Point-interactive Image Colorization"}],"methods":[{"method_slug":"colorization","method_name":"Colorization"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/point-interactive-image-colorization-on-cub","task":"Point-interactive Image Colorization","dataset":"CUB-200-2011","model":"iDeepColor","rank_in_archive_order":4,"of":7,"metrics":{"PSNR@1":"27.45","PSNR@10":"29.32","PSNR@100":"31.57"},"uses_additional_data":false},{"leaderboard":"/sota/point-interactive-image-colorization-on","task":"Point-interactive Image Colorization","dataset":"ImageNet ctest10k","model":"iDeepColor","rank_in_archive_order":3,"of":4,"metrics":{"PSNR@1":"26.937","PSNR@10":"29.009","PSNR@100":"31.58"},"uses_additional_data":false},{"leaderboard":"/sota/point-interactive-image-colorization-on-1","task":"Point-interactive Image Colorization","dataset":"Oxford 102 Flowers","model":"iDeepColor","rank_in_archive_order":3,"of":7,"metrics":{"PSNR@1":"22.72","PSNR@10":"25.13","PSNR@100":"27.826"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1705.02999","atlas_url":"https://app.syntology.ai/?focus=1705.02999","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}