{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-to-select-data-for-transfer-learning","title":"Learning to select data for transfer learning with Bayesian Optimization","arxiv_id":"1707.05246","date":"2017-07-17","proceeding":"EMNLP 2017 9","authors":["Sebastian Ruder","Barbara Plank"],"abstract":"Domain similarity measures can be used to gauge adaptability and select\nsuitable data for transfer learning, but existing approaches define ad hoc\nmeasures that are deemed suitable for respective tasks. Inspired by work on\ncurriculum learning, we propose to \\emph{learn} data selection measures using\nBayesian Optimization and evaluate them across models, domains and tasks. Our\nlearned measures outperform existing domain similarity measures significantly\non three tasks: sentiment analysis, part-of-speech tagging, and parsing. We\nshow the importance of complementing similarity with diversity, and that\nlearned measures are -- to some degree -- transferable across models, domains,\nand even tasks.","url_abs":"http://arxiv.org/abs/1707.05246v1","url_pdf":"http://arxiv.org/pdf/1707.05246v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-to-select-data-for-transfer-learning","repo_url":"https://github.com/sebastianruder/learn-to-select-data","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"part-of-speech-tagging","task_name":"Part-Of-Speech Tagging"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1707.05246","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}