{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/duet-optimizing-training-data-mixtures-via","title":"DUET: Optimizing Training Data Mixtures via Feedback from Unseen Evaluation Tasks","arxiv_id":"2502.00270","date":"2025-02-01","proceeding":null,"authors":["Zhiliang Chen","Gregory Kang Ruey Lau","Chuan-Sheng Foo","Bryan Kian Hsiang Low"],"abstract":"The performance of an LLM depends heavily on the relevance of its training data to the downstream evaluation task. However, in practice, the data involved in an unseen evaluation task is often unknown (e.g., conversations between an LLM and a user are end-to-end encrypted). Hence, it is unclear what data are relevant for fine-tuning the LLM to maximize its performance on the specific unseen evaluation task. Instead, one can only deploy the LLM on the unseen task to gather multiple rounds of feedback on how well the model performs (e.g., user ratings). This novel setting offers a refreshing perspective towards optimizing training data mixtures via feedback from an unseen evaluation task, which prior data mixing and selection works do not consider. Our paper presents DUET, a novel global-to-local algorithm that interleaves influence function as a data selection method with Bayesian optimization to optimize data mixture via feedback from a specific unseen evaluation task. By analyzing DUET's cumulative regret, we theoretically show that DUET converges to the optimal training data mixture for an unseen task even without any data knowledge of the task. Finally, our experiments across a variety of language tasks demonstrate that DUET outperforms existing data selection and mixing methods in the unseen-task setting.","url_abs":"https://arxiv.org/abs/2502.00270v2","url_pdf":"https://arxiv.org/pdf/2502.00270v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"duet-optimizing-training-data-mixtures-via","repo_url":"https://github.com/pmsdapfmbf/duet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2502.00270","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2502.00270"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/alstonlo/torch-influence","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pmsdapfmbf/duet","reach":null}],"summary":{"ran_draft_wrong":7,"ran_honours":1,"unverified":6},"by_repo_kind":{"official":{"samples":14,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4970ddf6ddc8fd27","entry":"calculate_accuracy","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4970ddf6ddc8fd27"}},{"code_sha256_prefix":"2642938bca13a388","entry":"evaluate_model","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2642938bca13a388"}},{"code_sha256_prefix":"1f936e2e8a935b8f","entry":"remove_lowest_influence_then_sample_based_on_IF","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1f936e2e8a935b8f"}},{"code_sha256_prefix":"f0b4db4a5d861b88","entry":"remove_lowest_influence_then_sample_uniformly","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f0b4db4a5d861b88"}},{"code_sha256_prefix":"0ae03fc766877a9c","entry":"sample_from_dataloader","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ae03fc766877a9c"}},{"code_sha256_prefix":"ce824445c33ab2e4","entry":"sample_from_influence","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ce824445c33ab2e4"}},{"code_sha256_prefix":"1b4323888c739ff2","entry":"take_highest_influence","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1b4323888c739ff2"}},{"code_sha256_prefix":"868ca549016fe2b9","entry":"train_model","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"868ca549016fe2b9"}},{"code_sha256_prefix":"d758a97f264ee7d7","entry":"get_data_from_mixing_ratio","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d758a97f264ee7d7"}},{"code_sha256_prefix":"d8095a305d1d358e","entry":"get_vgg_model","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d8095a305d1d358e"}},{"code_sha256_prefix":"71b085d95680b369","entry":"iterative_loop","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"71b085d95680b369"}},{"code_sha256_prefix":"3669cc3711a78acf","entry":"remove_tail_ends_then_uniform","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3669cc3711a78acf"}},{"code_sha256_prefix":"6b669daa78ab827e","entry":"sample_from","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6b669daa78ab827e"}},{"code_sha256_prefix":"cc175e23e0a2d108","entry":"train","repo":"pmsdapfmbf/duet","repo_kind":"official","path":"BO.py","file_url":"https://github.com/pmsdapfmbf/duet/blob/HEAD/BO.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc175e23e0a2d108"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}