{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/data-centric-semi-supervised-learning","title":"Unsupervised Selective Labeling for More Effective Semi-Supervised Learning","arxiv_id":"2110.03006","date":"2021-10-06","proceeding":null,"authors":["Xudong Wang","Long Lian","Stella X. Yu"],"abstract":"Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right data to label, in addition to usual SSL's propagating labels from labeled data to the rest unlabeled data. This instance selection task is challenging, as without any labeled data we do not know what the objective of learning should be. Intuitively, no matter what the downstream task is, instances to be labeled must be representative and diverse: The former would facilitate label propagation to unlabeled data, whereas the latter would ensure coverage of the entire dataset. We capture this idea by selecting cluster prototypes, either in a pretrained feature space, or along with feature optimization, both without labels. Our unsupervised selective labeling consistently improves SSL methods over state-of-the-art active learning given labeled data, by 8 to 25 times in label efficiency. For example, it boosts FixMatch by 10% (14%) in accuracy on CIFAR-10 (ImageNet-1K) with 0.08% (0.2%) labeled data, demonstrating that small computation spent on selecting what data to label brings significant gain especially under a low annotation budget. Our work sets a new standard for practical and efficient SSL.","url_abs":"https://arxiv.org/abs/2110.03006v4","url_pdf":"https://arxiv.org/pdf/2110.03006v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"data-centric-semi-supervised-learning","repo_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"semi-supervised-image-classification-cold","task_name":"Semi-Supervised Image Classification (Cold Start)"}],"methods":[{"method_slug":"fixmatch","method_name":"FixMatch"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/semi-supervised-image-classification-cold-2","task":"Semi-Supervised Image Classification (Cold Start)","dataset":"CIFAR-10, 100 Labels","model":"FixMatch-USL","rank_in_archive_order":2,"of":2,"metrics":{"Percentage error":"6.8"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-cold-8","task":"Semi-Supervised Image Classification (Cold Start)","dataset":"CIFAR-10, 40 Labels","model":"FixMatch-USL-T","rank_in_archive_order":1,"of":1,"metrics":{"Percentage error":"6.5"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2110.03006","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.03006"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"ran":5,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"18badd533b52adb3","entry":"accuracy","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-fixmatch-cifar/utils.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-fixmatch-cifar/utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"18badd533b52adb3"}},{"code_sha256_prefix":"fb569f13818701fc","entry":"conv","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-simclrv2/resnet.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-simclrv2/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb569f13818701fc"}},{"code_sha256_prefix":"23374018ab9941b5","entry":"evaluate_predictions","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"usl-t_pretraining/usl-t-imagenet-pretrain.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/usl-t_pretraining/usl-t-imagenet-pretrain.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23374018ab9941b5"}},{"code_sha256_prefix":"8c82d522e7c85b05","entry":"get_mean_and_std","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-fixmatch-cifar/utils.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-fixmatch-cifar/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c82d522e7c85b05"}},{"code_sha256_prefix":"0a7c46eb67c0c21b","entry":"mish","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-fixmatch-cifar/models/wideresnet.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-fixmatch-cifar/models/wideresnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a7c46eb67c0c21b"}},{"code_sha256_prefix":"0e80e018f0e62f7b","entry":"name_to_params","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-simclrv2/resnet.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-simclrv2/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e80e018f0e62f7b"}},{"code_sha256_prefix":"bc349fad528f976c","entry":"build_wideresnet","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-fixmatch-cifar/models/wideresnet.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-fixmatch-cifar/models/wideresnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc349fad528f976c"}},{"code_sha256_prefix":"1f977428f41dd1e0","entry":"get_resnet","repo":"TonyLianLong/UnsupervisedSelectiveLabeling","repo_kind":"official","path":"semisup-simclrv2/resnet.py","file_url":"https://github.com/TonyLianLong/UnsupervisedSelectiveLabeling/blob/HEAD/semisup-simclrv2/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f977428f41dd1e0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}