{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-regularization-parameter-estimation-under","title":"On Regularization Parameter Estimation under Covariate Shift","arxiv_id":"1608.00250","date":"2016-07-31","proceeding":null,"authors":["Wouter M. Kouw","Marco Loog"],"abstract":"This paper identifies a problem with the usual procedure for\nL2-regularization parameter estimation in a domain adaptation setting. In such\na setting, there are differences between the distributions generating the\ntraining data (source domain) and the test data (target domain). The usual\ncross-validation procedure requires validation data, which can not be obtained\nfrom the unlabeled target data. The problem is that if one decides to use\nsource validation data, the regularization parameter is underestimated. One\npossible solution is to scale the source validation data through importance\nweighting, but we show that this correction is not sufficient. We conclude the\npaper with an empirical analysis of the effect of several importance weight\nestimators on the estimation of the regularization parameter.","url_abs":"http://arxiv.org/abs/1608.00250v1","url_pdf":"http://arxiv.org/pdf/1608.00250v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-regularization-parameter-estimation-under","repo_url":"https://github.com/wmkouw/covshift-l2reg","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"domain-adaptation","task_name":"Domain Adaptation"},{"task_slug":"l2-regularization","task_name":"L2 Regularization"},{"task_slug":"parameter-estimation","task_name":"parameter estimation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}