{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/generative-image-inpainting-with-contextual","title":"Generative Image Inpainting with Contextual Attention","arxiv_id":"1801.07892","date":"2018-01-24","proceeding":"CVPR 2018 6","authors":["Jiahui Yu","Zhe Lin","Jimei Yang","Xiaohui Shen","Xin Lu","Thomas S. Huang"],"abstract":"Recent deep learning based approaches have shown promising results for the\nchallenging task of inpainting large missing regions in an image. These methods\ncan generate visually plausible image structures and textures, but often create\ndistorted structures or blurry textures inconsistent with surrounding areas.\nThis is mainly due to ineffectiveness of convolutional neural networks in\nexplicitly borrowing or copying information from distant spatial locations. On\nthe other hand, traditional texture and patch synthesis approaches are\nparticularly suitable when it needs to borrow textures from the surrounding\nregions. Motivated by these observations, we propose a new deep generative\nmodel-based approach which can not only synthesize novel image structures but\nalso explicitly utilize surrounding image features as references during network\ntraining to make better predictions. The model is a feed-forward, fully\nconvolutional neural network which can process images with multiple holes at\narbitrary locations and with variable sizes during the test time. Experiments\non multiple datasets including faces (CelebA, CelebA-HQ), textures (DTD) and\nnatural images (ImageNet, Places2) demonstrate that our proposed approach\ngenerates higher-quality inpainting results than existing ones. Code, demo and\nmodels are available at: https://github.com/JiahuiYu/generative_inpainting.","url_abs":"http://arxiv.org/abs/1801.07892v2","url_pdf":"http://arxiv.org/pdf/1801.07892v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/JiahuiYu/generative_inpainting","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/BaoGevvvv5/photo-restoration","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/CS269-Capstone/t-snake-capstone","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/CS269-Capstone/t-snake-mask-generation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/ChopsticksAN/generative_inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/DAA233/generative-inpainting-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/Ir1d/tf-models","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/ShnitzelKiller/generative_inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/TerminatorSd/generative","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/WonwoongCho/Generative-Inpainting-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/avalonstrel/GatedConvolution","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/boge8888/Watermark-removal-GUI","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/btxuyenHCMUS/generative","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/g2zac/generative_inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/i6092467/semi-supervised-multiview-cbm","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/jiajunhua/JiahuiYu-generative_inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/katychou/generative01","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/nuneslu/VeIGAN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/pfnet-research/Chainer-DeepFill","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/runze-wang-sjtu/generative_inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/sankalpdayal5/Image-Inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/sirius-image-inpainting/Generative-Image-Inpainting-with-Contextual-Attention","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/spollok/magfield-prediction","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/xurongchao/mv-inpainting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/yunjeongyong/Generative-Inpainting-pytorch-master","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/zphang/saliency_investigation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/zuruoke/watermark-removal","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"generative-image-inpainting-with-contextual","repo_url":"https://github.com/JennyVanessa/Deepfill-Paddle","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"image-inpainting","task_name":"Image Inpainting"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1801.07892","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}