Papers › Let there be color!: joint end-to-end learning of global and local image priors for...

Let there be color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification

1 Jul 2016ACM Transactions on Graphics 2016 7archive 2025-07-28

Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Ishikawa

We present a novel technique to automatically colorize grayscale images that combines both global priors and local image features. Based on Convolutional Neural Networks, our deep network features a fusion layer that allows us to elegantly merge local information dependent on small image patches with global priors computed using the entire image. The entire framework, including the global and local priors as well as the colorization model, is trained in an end-to-end fashion. Furthermore, our architecture can process images of any resolution, unlike most existing approaches based on CNN. We leverage an existing large-scale scene classification database to train our model, exploiting the class labels of the dataset to more efficiently and discriminatively learn the global priors. We validate our approach with a user study and compare against the state of the art, where we show significant improvements. Furthermore, we demonstrate our method extensively on many different types of images, including black-and-white photography from over a hundred years ago, and show realistic colorizations.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ColorizationImage ColorizationScene Classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Colorization

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections