Papers › Diverse Image-to-Image Translation via Disentangled Representations

Diverse Image-to-Image Translation via Disentangled Representations

2 Aug 2018ECCV 2018 9arXiv:1808.00948archive 2025-07-28

Hsin-Ying Lee, Hung-Yu Tseng, Jia-Bin Huang, Maneesh Kumar Singh, Ming-Hsuan Yang

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we present an approach based on disentangled representation for producing diverse outputs without paired training images. To achieve diversity, we propose to embed images onto two spaces: a domain-invariant content space capturing shared information across domains and a domain-specific attribute space. Our model takes the encoded content features extracted from a given input and the attribute vectors sampled from the attribute space to produce diverse outputs at test time. To handle unpaired training data, we introduce a novel cross-cycle consistency loss based on disentangled representations. Qualitative results show that our model can generate diverse and realistic images on a wide range of tasks without paired training data. For quantitative comparisons, we measure realism with user study and diversity with a perceptual distance metric. We apply the proposed model to domain adaptation and show competitive performance when compared to the state-of-the-art on the MNIST-M and the LineMod datasets.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

HsinYingLee/DRIT officialmentioned in papermentioned on GitHubpytorch report
Bingwen-Hu/DRIT mentioned on GitHubpytorch report
HsinYingLee/MDMM mentioned on GitHubpytorch report
Wenchao-Du/LIR-for-Unsupervised-IR mentioned on GitHubpytorch report
guy-oren/DIRT-OST mentioned on GitHubpytorch report
hytseng0509/DRIT_hr mentioned on GitHubpytorch report
taki0112/DRIT-Tensorflow mentioned on GitHubtfMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AttributeDiversityDomain AdaptationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image TranslationPerceptual DistanceSynthetic-to-Real TranslationTranslation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multimodal Unsupervised Image-To-Image Translation AFHQ DRIT FID 95.6 #4 of 4 Archive leaderboard report
Multimodal Unsupervised Image-To-Image Translation CelebA-HQ DRIT FID 52.1 #4 of 4 Archive leaderboard report
Synthetic-to-Real Translation GTAV-to-Cityscapes Labels Domain adaptation mIoU 43.2 #62 of 73 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionGlobal Average PoolingKaiming InitializationMax PoolingReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections