{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/most-influential-subset-selection-challenges","title":"Most Influential Subset Selection: Challenges, Promises, and Beyond","arxiv_id":"2409.18153","date":"2024-09-25","proceeding":null,"authors":["Yuzheng Hu","Pingbang Hu","Han Zhao","Jiaqi W. Ma"],"abstract":"How can we attribute the behaviors of machine learning models to their training data? While the classic influence function sheds light on the impact of individual samples, it often fails to capture the more complex and pronounced collective influence of a set of samples. To tackle this challenge, we study the Most Influential Subset Selection (MISS) problem, which aims to identify a subset of training samples with the greatest collective influence. We conduct a comprehensive analysis of the prevailing approaches in MISS, elucidating their strengths and weaknesses. Our findings reveal that influence-based greedy heuristics, a dominant class of algorithms in MISS, can provably fail even in linear regression. We delineate the failure modes, including the errors of influence function and the non-additive structure of the collective influence. Conversely, we demonstrate that an adaptive version of these heuristics which applies them iteratively, can effectively capture the interactions among samples and thus partially address the issues. Experiments on real-world datasets corroborate these theoretical findings and further demonstrate that the merit of adaptivity can extend to more complex scenarios such as classification tasks and non-linear neural networks. We conclude our analysis by emphasizing the inherent trade-off between performance and computational efficiency, questioning the use of additive metrics such as the Linear Datamodeling Score, and offering a range of discussions.","url_abs":"https://arxiv.org/abs/2409.18153v2","url_pdf":"https://arxiv.org/pdf/2409.18153v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"most-influential-subset-selection-challenges","repo_url":"https://github.com/sleepymalc/miss","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"computational-efficiency","task_name":"Computational Efficiency"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.18153","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.18153"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sleepymalc/miss","reach":{"status":"ok"}}],"summary":{"ran":9,"unverified":2},"by_repo_kind":{"official":{"samples":11,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":11,"samples":[{"code_sha256_prefix":"389da74decf16d54","entry":"adaptive_first_order","repo":"sleepymalc/miss","repo_kind":"official","path":"logistic_regression/IF.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/logistic_regression/IF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"389da74decf16d54"}},{"code_sha256_prefix":"df23da82fbd7ff7b","entry":"count_parameters","repo":"sleepymalc/miss","repo_kind":"official","path":"MLP/utlis/grad_calculator.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/MLP/utlis/grad_calculator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"df23da82fbd7ff7b"}},{"code_sha256_prefix":"7da23eb5e99526c4","entry":"data_generation","repo":"sleepymalc/miss","repo_kind":"official","path":"MLP/utlis/data.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/MLP/utlis/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7da23eb5e99526c4"}},{"code_sha256_prefix":"1e7c95c2a848bc1f","entry":"first_order","repo":"sleepymalc/miss","repo_kind":"official","path":"logistic_regression/IF.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/logistic_regression/IF.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1e7c95c2a848bc1f"}},{"code_sha256_prefix":"16e9d14348d7b5ce","entry":"grad_calculator","repo":"sleepymalc/miss","repo_kind":"official","path":"MLP/utlis/grad_calculator.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/MLP/utlis/grad_calculator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"16e9d14348d7b5ce"}},{"code_sha256_prefix":"1def74edcd0ae636","entry":"parameters_to_vector","repo":"sleepymalc/miss","repo_kind":"official","path":"MLP/utlis/grad_calculator.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/MLP/utlis/grad_calculator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1def74edcd0ae636"}},{"code_sha256_prefix":"01825b27c662afc5","entry":"parse_range","repo":"sleepymalc/miss","repo_kind":"official","path":"MLP/MISS.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/MLP/MISS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"01825b27c662afc5"}},{"code_sha256_prefix":"83e51d0a4268dc41","entry":"rankmin","repo":"sleepymalc/miss","repo_kind":"official","path":"metric.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"83e51d0a4268dc41"}},{"code_sha256_prefix":"d81973c9f942192a","entry":"winning_rate","repo":"sleepymalc/miss","repo_kind":"official","path":"metric.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d81973c9f942192a"}},{"code_sha256_prefix":"f4ba7de56847ffa5","entry":"LAGS","repo":"sleepymalc/miss","repo_kind":"official","path":"linear_regression/LAGS.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/linear_regression/LAGS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f4ba7de56847ffa5"}},{"code_sha256_prefix":"fc021c18a536d694","entry":"adaptive_LAGS","repo":"sleepymalc/miss","repo_kind":"official","path":"linear_regression/LAGS.py","file_url":"https://github.com/sleepymalc/miss/blob/HEAD/linear_regression/LAGS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc021c18a536d694"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}