Papers › Cross-Domain Ensemble Distillation for Domain Generalization

Cross-Domain Ensemble Distillation for Domain Generalization

25 Nov 2022European Conference on Computer Vision (ECCV) 2022 10arXiv:2211.14058archive 2025-07-28

kyungmoon lee, Sungyeon Kim, Suha Kwak

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant features while encouraging the model to converge to flat minima, which recently turned out to be a sufficient condition for domain generalization. To this end, our method generates an ensemble of the output logits from training data with the same label but from different domains and then penalizes each output for the mismatch with the ensemble. Also, we present a de-stylization technique that standardizes features to encourage the model to produce style-consistent predictions even in an arbitrary target domain. Our method greatly improves generalization capability in public benchmarks for cross-domain image classification, cross-dataset person re-ID, and cross-dataset semantic segmentation. Moreover, we show that models learned by our method are robust against adversarial attacks and image corruptions.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

leekyungmoon/XDED officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Domain GeneralizationImage ClassificationImage to sketch recognitionSemantic SegmentationSingle-Source Domain Generalizationimage-classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Domain Generalization Office-Home XDED (ResNet-18) Average Accuracy 67.4 #38 of 45 Archive leaderboard report
Domain Generalization PACS XDED (ResNet-18) Average Accuracy 86.4 #48 of 133 Archive leaderboard report
Image to sketch recognition PACS XDED (ResNet18) Accuracy 51.5 #5 of 7 Archive leaderboard report
Single-Source Domain Generalization PACS XDED (ResNet18) Accuracy 66.5 #6 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections