Papers › Double-Weighting for Covariate Shift Adaptation

Double-Weighting for Covariate Shift Adaptation

15 May 2023arXiv:2305.08637archive 2025-07-28

José I. Segovia-Martín, Santiago Mazuelas, Anqi Liu

Supervised learning is often affected by a covariate shift in which the marginal distributions of instances (covariates x) of training and testing samples pₜᵣ(x) and pₜₑ(x) are different but the label conditionals coincide. Existing approaches address such covariate shift by either using the ratio pₜₑ(x)/pₜᵣ(x) to weight training samples (reweighted methods) or using the ratio pₜᵣ(x)/pₜₑ(x) to weight testing samples (robust methods). However, the performance of such approaches can be poor under support mismatch or when the above ratios take large values. We propose a minimax risk classification (MRC) approach for covariate shift adaptation that avoids such limitations by weighting both training and testing samples. In addition, we develop effective techniques that obtain both sets of weights and generalize the conventional kernel mean matching method. We provide novel generalization bounds for our method that show a significant increase in the effective sample size compared with reweighted methods. The proposed method also achieves enhanced classification performance in both synthetic and empirical experiments.

PaperPDFCode

Code

machinelearningbcam/mrcs-for-covariate-shift-adaptation officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Generalization Bounds

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections