{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sketchdeco-decorating-b-w-sketches-with","title":"SketchDeco: Decorating B&W Sketches with Colour","arxiv_id":"2405.18716","date":"2024-05-29","proceeding":null,"authors":["Chaitat Utintu","Pinaki Nath Chowdhury","Aneeshan Sain","Subhadeep Koley","Ayan Kumar Bhunia","Yi-Zhe Song"],"abstract":"This paper introduces a novel approach to sketch colourisation, inspired by the universal childhood activity of colouring and its professional applications in design and story-boarding. Striking a balance between precision and convenience, our method utilises region masks and colour palettes to allow intuitive user control, steering clear of the meticulousness of manual colour assignments or the limitations of textual prompts. By strategically combining ControlNet and staged generation, incorporating Stable Diffusion v1.5, and leveraging BLIP-2 text prompts, our methodology facilitates faithful image generation and user-directed colourisation. Addressing challenges of local and global consistency, we employ inventive solutions such as an inversion scheme, guided sampling, and a self-attention mechanism with a scaling factor. The resulting tool is not only fast and training-free but also compatible with consumer-grade Nvidia RTX 4090 Super GPUs, making it a valuable asset for both creative professionals and enthusiasts in various fields. Project Page: \\url{https://chaitron.github.io/SketchDeco/}","url_abs":"https://arxiv.org/abs/2405.18716v1","url_pdf":"https://arxiv.org/pdf/2405.18716v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sketchdeco-decorating-b-w-sketches-with","repo_url":"https://github.com/CHAITron/sketchdeco-code","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-colorization","task_name":"Image Colorization"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"sketch-colorization","task_name":"Sketch Colorization"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"sag","method_name":"Self-Attention Guidance"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2405.18716","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}