IntHarmony

This newly curated synthetic dataset specifies an additional reference region to guide image harmonization. There are 118,287 training images and 959 test images. The dataset consists of objects, backgrounds, and people.

IntHarmony has the following information for each data instance: composite image, ground truth, foreground mask of the composite foreground, and a guide mask that provides information about the reference region to guide harmonization.

IntHarmony is built on top of the MS-COCO dataset, and makes use of the instance masks provided in MS-COCO to simulate foreground and reference regions. First, a random instance mask is selected to pick the foreground region. The selected foreground region is then augmented using a wide set of meaningful augmentations focusing on luminance, contrast and color. Another random instance mask is used to get the reference guide mask. The original image is considered the ground truth. The instance masks and the augmentations are chosen at random to induce more generalizability to the network.