{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/coloring-with-words-guiding-image","title":"Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation","arxiv_id":"1804.04128","date":"2018-04-11","proceeding":"ECCV 2018 9","authors":["Hyojin Bahng","Seungjoo Yoo","Wonwoong Cho","David K. Park","Ziming Wu","Xiaojuan Ma","Jaegul Choo"],"abstract":"This paper proposes a novel approach to generate multiple color palettes that\nreflect the semantics of input text and then colorize a given grayscale image\naccording to the generated color palette. In contrast to existing approaches,\nour model can understand rich text, whether it is a single word, a phrase, or a\nsentence, and generate multiple possible palettes from it. For this task, we\nintroduce our manually curated dataset called Palette-and-Text (PAT). Our\nproposed model called Text2Colors consists of two conditional generative\nadversarial networks: the text-to-palette generation networks and the\npalette-based colorization networks. The former captures the semantics of the\ntext input and produce relevant color palettes. The latter colorizes a\ngrayscale image using the generated color palette. Our evaluation results show\nthat people preferred our generated palettes over ground truth palettes and\nthat our model can effectively reflect the given palette when colorizing an\nimage.","url_abs":"http://arxiv.org/abs/1804.04128v2","url_pdf":"http://arxiv.org/pdf/1804.04128v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"coloring-with-words-guiding-image","repo_url":"https://github.com/awesome-davian/Text2Colors","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"colorization","task_name":"Colorization"},{"task_slug":"image-colorization","task_name":"Image Colorization"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[{"method_slug":"colorization","method_name":"Colorization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1804.04128","atlas_url":"https://app.syntology.ai/?focus=1804.04128","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}