{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2511-17399","title":"Stable Coresets via Posterior Sampling: Aligning Induced and Full Loss Landscapes","arxiv_id":"2511.17399","date":"2025-11-21","proceeding":"NeurIPS","authors":["Wei-Kai Chang","Rajiv Khanna"],"abstract":"As deep learning models continue to scale, the growing computational demands have amplified the need for effective coreset selection techniques. Coreset selection aims to accelerate training by identifying small, representative subsets of data that approximate the performance of the full dataset. Among various approaches, gradient based methods stand out due to their strong theoretical underpinnings and practical benefits, particularly under limited data budgets. However, these methods face challenges such as naive stochastic gradient descent (SGD) acting as a surprisingly strong baseline and the breakdown of representativeness due to loss curvature mismatches over time. In this work, we propose a novel framework that addresses these limitations. First, we establish a connection between posterior sampling and loss landscapes, enabling robust coreset selection even in high data corruption scenarios. Second, we introduce a smoothed loss function based on posterior sampling onto the model weights, enhancing stability and generalization while maintaining computational efficiency. We also present a novel convergence analysis for our sampling-based coreset selection method. Finally, through extensive experiments, we demonstrate how our approach achieves faster training and enhanced generalization across diverse datasets than the current state of the art.","url_abs":"https://arxiv.org/abs/2511.17399","url_pdf":"https://arxiv.org/pdf/2511.17399","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2511.17399","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2511.17399"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/changwk1001/stable-coreset","reach":{"status":"ok","spdx":"MIT"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/decile-team/cords","reach":{"status":"ok","spdx":"MIT"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/opooladz/AdaCore","reach":{"status":"ok"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/PatrickZH/DeepCore","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran":2,"unverified":27},"by_repo_kind":{"found_in_text":{"samples":31,"ran":4,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2a80220dabcb742a","entry":"conv1x1","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet50.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet50.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a80220dabcb742a"}},{"code_sha256_prefix":"600ff2c45e0de056","entry":"conv3x3","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet50_noise.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet50_noise.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"600ff2c45e0de056"}},{"code_sha256_prefix":"4304a326c593f8db","entry":"drop_connect","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/models/efficientnet.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/models/efficientnet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4304a326c593f8db"}},{"code_sha256_prefix":"8737c82de631cffc","entry":"swish","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/models/efficientnet.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/models/efficientnet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8737c82de631cffc"}},{"code_sha256_prefix":"75af3219fc982938","entry":"CIFAR10","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/cifar10.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/cifar10.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75af3219fc982938"}},{"code_sha256_prefix":"40f14e833983504f","entry":"CIFAR100","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/cifar100.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/cifar100.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40f14e833983504f"}},{"code_sha256_prefix":"7739b17779992680","entry":"EfficientNetB0","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/models/efficientnet.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/models/efficientnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7739b17779992680"}},{"code_sha256_prefix":"3a1159843af3c3ec","entry":"FashionMNIST","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/fashionmnist.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/fashionmnist.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a1159843af3c3ec"}},{"code_sha256_prefix":"7ed41a50eddb9b77","entry":"ImageNet","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/imagenet.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/imagenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7ed41a50eddb9b77"}},{"code_sha256_prefix":"e33c212a7caeec80","entry":"LeNet","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/lenet.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/lenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e33c212a7caeec80"}},{"code_sha256_prefix":"386d95ec922f5372","entry":"MNIST","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/mnist.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/mnist.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"386d95ec922f5372"}},{"code_sha256_prefix":"40ede1696f832327","entry":"QMNIST","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/qmnist.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/qmnist.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40ede1696f832327"}},{"code_sha256_prefix":"1fb158f9e4bd423e","entry":"ResNet18","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet18.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet18.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1fb158f9e4bd423e"}},{"code_sha256_prefix":"04fdb7a8c1df3d72","entry":"ResNet18_noise_bn","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet18_noise.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet18_noise.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"04fdb7a8c1df3d72"}},{"code_sha256_prefix":"64abbddd837f0469","entry":"ResNet20","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet20.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet20.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64abbddd837f0469"}},{"code_sha256_prefix":"f9d6bbd93aef162b","entry":"ResNet20_noise_bn","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet20_noise.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet20_noise.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9d6bbd93aef162b"}},{"code_sha256_prefix":"48dc10fe0cd21883","entry":"ResNet50","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet50.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet50.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48dc10fe0cd21883"}},{"code_sha256_prefix":"0df3f26e16e02da4","entry":"ResNet50_noise_bn","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"models/resnet50_noise.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/models/resnet50_noise.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0df3f26e16e02da4"}},{"code_sha256_prefix":"dc073038485c5091","entry":"SVHN","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/svhn.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/svhn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc073038485c5091"}},{"code_sha256_prefix":"24ff3b24e8204dd5","entry":"TinyImageNet","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/tinyimagenet.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/tinyimagenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24ff3b24e8204dd5"}},{"code_sha256_prefix":"8f56c32c9d619c3a","entry":"cache_dataset","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/indexed_dataset.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/indexed_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8f56c32c9d619c3a"}},{"code_sha256_prefix":"3510be843c036da0","entry":"cluster_features","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/subset.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/subset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3510be843c036da0"}},{"code_sha256_prefix":"c4cc0545d245c414","entry":"conv3x3","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/models/cnn13.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/models/cnn13.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4cc0545d245c414"}},{"code_sha256_prefix":"2b416a2f9e2d93a6","entry":"corrupt_labels","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/datasets.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b416a2f9e2d93a6"}},{"code_sha256_prefix":"db5e0ae7180f226c","entry":"corrupted_data","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/datasets.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"db5e0ae7180f226c"}},{"code_sha256_prefix":"2164acc3208491b1","entry":"distribute_subset","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/subset.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/subset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2164acc3208491b1"}},{"code_sha256_prefix":"6255b9f39cbbc395","entry":"fopen","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/config_utils.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/config_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6255b9f39cbbc395"}},{"code_sha256_prefix":"81a95f056e855f73","entry":"get_dataset","repo":"changwk1001/stable-coreset","repo_kind":"found_in_text","path":"mydatasets/datasets.py","file_url":"https://github.com/changwk1001/stable-coreset/blob/HEAD/mydatasets/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81a95f056e855f73"}},{"code_sha256_prefix":"0c0ab5d79fecced4","entry":"is_filepath","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/config_utils.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/config_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c0ab5d79fecced4"}},{"code_sha256_prefix":"6e999ce8f0a794ff","entry":"is_str","repo":"decile-team/cords","repo_kind":"found_in_text","path":"cords/utils/config_utils.py","file_url":"https://github.com/decile-team/cords/blob/HEAD/cords/utils/config_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e999ce8f0a794ff"}},{"code_sha256_prefix":"833c06fc635e87be","entry":"permutedMNIST","repo":"PatrickZH/DeepCore","repo_kind":"found_in_text","path":"deepcore/datasets/mnist.py","file_url":"https://github.com/PatrickZH/DeepCore/blob/HEAD/deepcore/datasets/mnist.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"833c06fc635e87be"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}