Papers › Rethinking Multi-domain Generalization with A General Learning Objective

Rethinking Multi-domain Generalization with A General Learning Objective

29 Feb 2024CVPR 2024 1arXiv:2402.18853archive 2025-07-28

Zhaorui Tan, Xi Yang, Kaizhu Huang

Multi-domain generalization (mDG) is universally aimed to minimize the discrepancy between training and testing distributions to enhance marginal-to-label distribution mapping. However, existing mDG literature lacks a general learning objective paradigm and often imposes constraints on static target marginal distributions. In this paper, we propose to leverage a Y-mapping to relax the constraint. We rethink the learning objective for mDG and design a new \textbf{general learning objective} to interpret and analyze most existing mDG wisdom. This general objective is bifurcated into two synergistic amis: learning domain-independent conditional features and maximizing a posterior. Explorations also extend to two effective regularization terms that incorporate prior information and suppress invalid causality, alleviating the issues that come with relaxed constraints. We theoretically contribute an upper bound for the domain alignment of domain-independent conditional features, disclosing that many previous mDG endeavors actually \textbf{optimize partially the objective} and thus lead to limited performance. As such, our study distills a general learning objective into four practical components, providing a general, robust, and flexible mechanism to handle complex domain shifts. Extensive empirical results indicate that the proposed objective with Y-mapping leads to substantially better mDG performance in various downstream tasks, including regression, segmentation, and classification.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

zhaorui-tan/gmdg officialmentioned in papermentioned on GitHubpytorch report
zhaorui-tan/GMDG_cvpr2024 officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Domain Generalization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Domain Generalization DomainNet GMDG (RegNetY-16GF, SWAD) Average Accuracy 61.3 #8 of 38 Archive leaderboard report
Domain Generalization DomainNet GMDG (RegNetY-16GF) Average Accuracy 54.6 #18 of 38 Archive leaderboard report
Domain Generalization DomainNet GMDG (ResNet-50, SWAD) Average Accuracy 47.3 #26 of 38 Archive leaderboard report
Domain Generalization DomainNet GMDG (ResNet-50) Average Accuracy 44.6 #32 of 38 Archive leaderboard report
Domain Generalization Office-Home GMDG (RegNetY-16GF, SWAD) Average Accuracy 84.7 #7 of 45 Archive leaderboard report
Domain Generalization Office-Home GMDG (RegNetY-16GF) Average Accuracy 80.8 #14 of 45 Archive leaderboard report
Domain Generalization Office-Home GMDG (ResNet-50, SWAD) Average Accuracy 72.5 #24 of 45 Archive leaderboard report
Domain Generalization Office-Home GMDG (ResNet-50) Average Accuracy 70.7 #29 of 45 Archive leaderboard report
Domain Generalization PACS GMDG (RegNetY-16GF, SWAD) Average Accuracy 97.9 #3 of 133 Archive leaderboard report
Domain Generalization PACS GMDG (e RegNetY-16GF) Average Accuracy 97.3 #6 of 133 Archive leaderboard report
Domain Generalization PACS GMDG (ResNet-50, SWAD) Average Accuracy 88.4 #29 of 133 Archive leaderboard report
Domain Generalization PACS GMDG (ResNet-50) Average Accuracy 85.6 #50 of 133 Archive leaderboard report
Domain Generalization TerraIncognita GMDG (RegNetY-16GF, SWAD) Average Accuracy 65 #2 of 30 Archive leaderboard report
Domain Generalization TerraIncognita GMDG (RegNetY-16GF) Average Accuracy 60.7 #6 of 30 Archive leaderboard report
Domain Generalization TerraIncognita GMDG (ResNet-50, SWAD) Average Accuracy 53.0 #15 of 30 Archive leaderboard report
Domain Generalization TerraIncognita GMDG (ResNet-50) Average Accuracy 51.1 #21 of 30 Archive leaderboard report
Domain Generalization VLCS GMDG (RegNetY-16GF) Average Accuracy 82.4 #10 of 37 Archive leaderboard report
Domain Generalization VLCS GMDG (RegNetY-16GF, SWAD) Average Accuracy 82.2 #15 of 37 Archive leaderboard report
Domain Generalization VLCS GMDG (ResNet-50, SWAD) Average Accuracy 79.6 #25 of 37 Archive leaderboard report
Domain Generalization VLCS GMDG (ResNet-50) Average Accuracy 79.2 #28 of 37 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections