{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/less-is-better-unweighted-data-subsampling","title":"Less Is Better: Unweighted Data Subsampling via Influence Function","arxiv_id":"1912.01321","date":"2019-12-03","proceeding":null,"authors":["Zifeng Wang","Hong Zhu","Zhenhua Dong","Xiuqiang He","Shao-Lun Huang"],"abstract":"In the time of Big Data, training complex models on large-scale data sets is challenging, making it appealing to reduce data volume for saving computation resources by subsampling. Most previous works in subsampling are weighted methods designed to help the performance of subset-model approach the full-set-model, hence the weighted methods have no chance to acquire a subset-model that is better than the full-set-model. However, we question that how can we achieve better model with less data? In this work, we propose a novel Unweighted Influence Data Subsampling (UIDS) method, and prove that the subset-model acquired through our method can outperform the full-set-model. Besides, we show that overly confident on a given test set for sampling is common in Influence-based subsampling methods, which can eventually cause our subset-model's failure in out-of-sample test. To mitigate it, we develop a probabilistic sampling scheme to control the worst-case risk over all distributions close to the empirical distribution. The experiment results demonstrate our methods superiority over existed subsampling methods in diverse tasks, such as text classification, image classification, click-through prediction, etc.","url_abs":"https://arxiv.org/abs/1912.01321v3","url_pdf":"https://arxiv.org/pdf/1912.01321v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"less-is-better-unweighted-data-subsampling","repo_url":"https://github.com/RyanWangZf/Influence_Subsampling","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"text-classification","task_name":"Text Classification"},{"task_slug":"image-classification","task_name":"image-classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1912.01321","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.01321"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/RyanWangZf/Influence_Subsampling","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":14},"by_repo_kind":{"official":{"samples":14,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2e20937cad0ddd9a","entry":"approx_fhess_p","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"optimize/optimize.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/optimize/optimize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e20937cad0ddd9a"}},{"code_sha256_prefix":"d5642c8420f7bba8","entry":"batch_grad_hinge_loss","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_hinge.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_hinge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d5642c8420f7bba8"}},{"code_sha256_prefix":"7ad9eacf99eab2a0","entry":"batch_grad_logloss_lr","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_utils.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7ad9eacf99eab2a0"}},{"code_sha256_prefix":"3233bd109d1f909c","entry":"grad_logloss_theta_lr","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_utils.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3233bd109d1f909c"}},{"code_sha256_prefix":"dca49c84f049b50f","entry":"grad_logloss_theta_lr_weighted","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_utils.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dca49c84f049b50f"}},{"code_sha256_prefix":"cbdcf53d06b53bfe","entry":"hessian_hingle_loss_theta","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_hinge.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_hinge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cbdcf53d06b53bfe"}},{"code_sha256_prefix":"05e08969eeda4bf5","entry":"hessian_vector_product_hinge","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"grad_hinge.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/grad_hinge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05e08969eeda4bf5"}},{"code_sha256_prefix":"bdbef0cefef7dced","entry":"load_data","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"dataset.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bdbef0cefef7dced"}},{"code_sha256_prefix":"b6da66a26efe3379","entry":"load_data_v1","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"dataset.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6da66a26efe3379"}},{"code_sha256_prefix":"53cd1d2e64bc0a52","entry":"parse_line_ffm","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"process_data.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/process_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53cd1d2e64bc0a52"}},{"code_sha256_prefix":"fd5dfd221bd89479","entry":"parse_line_fm","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"process_data.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/process_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd5dfd221bd89479"}},{"code_sha256_prefix":"899d22e360be7246","entry":"select_from_one_class","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"dataset.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"899d22e360be7246"}},{"code_sha256_prefix":"b9278c6ddf04cba8","entry":"work","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"process_data.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/process_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b9278c6ddf04cba8"}},{"code_sha256_prefix":"63fefa1d19885deb","entry":"wrap_function","repo":"RyanWangZf/Influence_Subsampling","repo_kind":"official","path":"optimize/optimize.py","file_url":"https://github.com/RyanWangZf/Influence_Subsampling/blob/HEAD/optimize/optimize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"63fefa1d19885deb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}