Papers › iColoriT: Towards Propagating Local Hint to the Right Region in Interactive...

iColoriT: Towards Propagating Local Hint to the Right Region in Interactive Colorization by Leveraging Vision Transformer

14 Jul 2022arXiv:2207.06831archive 2025-07-28

Jooyeol Yun, Sanghyeon Lee, Minho Park, Jaegul Choo

Point-interactive image colorization aims to colorize grayscale images when a user provides the colors for specific locations. It is essential for point-interactive colorization methods to appropriately propagate user-provided colors (i.e., user hints) in the entire image to obtain a reasonably colorized image with minimal user effort. However, existing approaches often produce partially colorized results due to the inefficient design of stacking convolutional layers to propagate hints to distant relevant regions. To address this problem, we present iColoriT, a novel point-interactive colorization Vision Transformer capable of propagating user hints to relevant regions, leveraging the global receptive field of Transformers. The self-attention mechanism of Transformers enables iColoriT to selectively colorize relevant regions with only a few local hints. Our approach colorizes images in real-time by utilizing pixel shuffling, an efficient upsampling technique that replaces the decoder architecture. Also, in order to mitigate the artifacts caused by pixel shuffling with large upsampling ratios, we present the local stabilizing layer. Extensive quantitative and qualitative results demonstrate that our approach highly outperforms existing methods for point-interactive colorization, producing accurately colorized images with a user's minimal effort. Official codes are available at https://pmh9960.github.io/research/iColoriT

PaperPDFCode

Code

pmh9960/iColoriT officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ColorizationDecoderImage ColorizationPoint-interactive Image Colorization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Point-interactive Image Colorization CUB-200-2011 iColoriT PSNR@1 27.986 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 iColoriT PSNR@10 30.595 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 iColoriT PSNR@100 33.543 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 InstColor PSNR@1 27.69 #3 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 InstColor PSNR@10 29.45 #3 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 InstColor PSNR@100 31.45 #3 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 iDeepColor PSNR@1 27.45 #5 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 iDeepColor PSNR@10 29.32 #5 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 iDeepColor PSNR@100 31.57 #5 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 SWF PSNR@1 23.547 #7 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 SWF PSNR@10 25.097 #7 of 7 Archive leaderboard report
Point-interactive Image Colorization CUB-200-2011 SWF PSNR@100 27.623 #7 of 7 Archive leaderboard report
Point-interactive Image Colorization ImageNet ctest10k iColoriT PSNR@1 27.474 #1 of 4 Archive leaderboard report
Point-interactive Image Colorization ImageNet ctest10k iColoriT PSNR@10 30.626 #1 of 4 Archive leaderboard report
Point-interactive Image Colorization ImageNet ctest10k iColoriT PSNR@100 33.787 #1 of 4 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iColoriT PSNR@1 22.925 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iColoriT PSNR@10 27.37 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iColoriT PSNR@100 30.731 #1 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iDeepColor PSNR@1 22.72 #4 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iDeepColor PSNR@10 25.13 #4 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers iDeepColor PSNR@100 27.826 #4 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers SWF PSNR@1 18.452 #6 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers SWF PSNR@10 19.445 #6 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers SWF PSNR@100 22.362 #6 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers InstColor PSNR@1 22.97 #7 of 7 Archive leaderboard report
Point-interactive Image Colorization Oxford 102 Flowers InstColor PSNR@100 27.35 #7 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamBPEColorizationDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformerVision Transformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections