{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/spanning-training-progress-temporal-dual","title":"Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning","arxiv_id":"2311.13613","date":"2023-11-22","proceeding":"CVPR 2024 1","authors":["Xin Zhang","Jiawei Du","Yunsong Li","Weiying Xie","Joey Tianyi Zhou"],"abstract":"Dataset pruning aims to construct a coreset capable of achieving performance comparable to the original, full dataset. Most existing dataset pruning methods rely on snapshot-based criteria to identify representative samples, often resulting in poor generalization across various pruning and cross-architecture scenarios. Recent studies have addressed this issue by expanding the scope of training dynamics considered, including factors such as forgetting event and probability change, typically using an averaging approach. However, these works struggle to integrate a broader range of training dynamics without overlooking well-generalized samples, which may not be sufficiently highlighted in an averaging manner. In this study, we propose a novel dataset pruning method termed as Temporal Dual-Depth Scoring (TDDS), to tackle this problem. TDDS utilizes a dual-depth strategy to achieve a balance between incorporating extensive training dynamics and identifying representative samples for dataset pruning. In the first depth, we estimate the series of each sample's individual contributions spanning the training progress, ensuring comprehensive integration of training dynamics. In the second depth, we focus on the variability of the sample-wise contributions identified in the first depth to highlight well-generalized samples. Extensive experiments conducted on CIFAR and ImageNet datasets verify the superiority of TDDS over previous SOTA methods. Specifically on CIFAR-100, our method achieves 54.51% accuracy with only 10% training data, surpassing random selection by 7.83% and other comparison methods by at least 12.69%.","url_abs":"https://arxiv.org/abs/2311.13613v3","url_pdf":"https://arxiv.org/pdf/2311.13613v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"spanning-training-progress-temporal-dual","repo_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"}],"methods":[{"method_slug":"dataset-pruning","method_name":"Dataset Pruning"},{"method_slug":"focus","method_name":"Focus"},{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.13613","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.13613"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"ran_draft_wrong":1,"ran":4,"unverified":5},"by_repo_kind":{"official":{"samples":11,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8843a54c072af40d","entry":"accuracy","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"train_subset.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/train_subset.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8843a54c072af40d"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"09b3d0b3ea772a30","entry":"convert_secs2time","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"utils.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09b3d0b3ea772a30"}},{"code_sha256_prefix":"57fc0e1e29d78784","entry":"resnet18","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"57fc0e1e29d78784"}},{"code_sha256_prefix":"05279061258bad37","entry":"resnet34","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05279061258bad37"}},{"code_sha256_prefix":"56c1ad0817555115","entry":"timing","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"utils.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56c1ad0817555115"}},{"code_sha256_prefix":"daa31faafe9d2c13","entry":"load_cifar10","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"data.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"daa31faafe9d2c13"}},{"code_sha256_prefix":"6e9d3041de98459f","entry":"load_cifar100_sub","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"data_subset.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/data_subset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e9d3041de98459f"}},{"code_sha256_prefix":"d76e1513b30de7b0","entry":"load_cifar10_sub","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"data_subset.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/data_subset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d76e1513b30de7b0"}},{"code_sha256_prefix":"c7f5913a14f9acc7","entry":"load_data","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"data.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7f5913a14f9acc7"}},{"code_sha256_prefix":"b1fdb6855e14c54f","entry":"load_dataset","repo":"zhangxin-xd/Dataset-Pruning-TDDS","repo_kind":"official","path":"data.py","file_url":"https://github.com/zhangxin-xd/Dataset-Pruning-TDDS/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1fdb6855e14c54f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}