{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/instant-semi-supervised-learning-with","title":"InstanT: Semi-supervised Learning with Instance-dependent Thresholds","arxiv_id":"2310.18910","date":"2023-10-29","proceeding":"NeurIPS 2023 11","authors":[],"abstract":"Semi-supervised learning (SSL) has been a fundamental challenge in machine learning for decades. The primary family of SSL algorithms, known as pseudo-labeling, involves assigning pseudo-labels to confident unlabeled instances and incorporating them into the training set. Therefore, the selection criteria of confident instances are crucial to the success of SSL. Recently, there has been growing interest in the development of SSL methods that use dynamic or adaptive thresholds. Yet, these methods typically apply the same threshold to all samples, or use class-dependent thresholds for instances belonging to a certain class, while neglecting instance-level information. In this paper, we propose the study of instance-dependent thresholds, which has the highest degree of freedom compared with existing methods. Specifically, we devise a novel instance-dependent threshold function for all unlabeled instances by utilizing their instance-level ambiguity and the instance-dependent error rates of pseudo-labels, so instances that are more likely to have incorrect pseudo-labels will have higher thresholds. Furthermore, we demonstrate that our instance-dependent threshold function provides a bounded probabilistic guarantee for the correctness of the pseudo-labels it assigns.","url_abs":"https://arxiv.org/abs/2310.18910v1","url_pdf":"https://arxiv.org/pdf/2310.18910v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"instant-semi-supervised-learning-with","repo_url":"https://github.com/tmllab/2023_neurips_instant","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.18910","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.18910"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/tmllab/2023_NeurIPS_InstanT","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tmllab/2023_neurips_instant","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"ran_draft_wrong":4,"ran_honours":1,"unverified":2},"by_repo_kind":{"listed":{"samples":17,"ran":15,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"beac57554acf9059","entry":"ResNet18","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/T_estimator.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/T_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"beac57554acf9059"}},{"code_sha256_prefix":"0c13dc8a530b0d98","entry":"ResNet18","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/adamatch/T_estimator.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/adamatch/T_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c13dc8a530b0d98"}},{"code_sha256_prefix":"24d4d25eca66aa00","entry":"ResNet18_F","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/T_estimator.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/T_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24d4d25eca66aa00"}},{"code_sha256_prefix":"c71e1006cf68d9de","entry":"ResNet18_N","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/T_estimator.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/T_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c71e1006cf68d9de"}},{"code_sha256_prefix":"cc902b5d29331c9e","entry":"ResNet34","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/adamatch/T_estimator.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/adamatch/T_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc902b5d29331c9e"}},{"code_sha256_prefix":"dc61eede543c56fc","entry":"array_to_bytes","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"preprocess/preprocess_superb.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/preprocess/preprocess_superb.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc61eede543c56fc"}},{"code_sha256_prefix":"b19e0120c50d4fd0","entry":"bytes_to_array","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"preprocess/preprocess_superb.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/preprocess/preprocess_superb.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b19e0120c50d4fd0"}},{"code_sha256_prefix":"fce793d46d313f8b","entry":"class_forward_loss","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fce793d46d313f8b"}},{"code_sha256_prefix":"51c251b61229e788","entry":"error","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"51c251b61229e788"}},{"code_sha256_prefix":"88f4962784e09b88","entry":"param_groups_weight_decay","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/nets/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/nets/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88f4962784e09b88"}},{"code_sha256_prefix":"d954c448e1eee8c4","entry":"read_TextClassificationDatasets","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"preprocess/preprocess_aclimdb.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/preprocess/preprocess_aclimdb.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d954c448e1eee8c4"}},{"code_sha256_prefix":"eed03e5ff5639e09","entry":"read_aclImdb","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"preprocess/preprocess_aclimdb.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/preprocess/preprocess_aclimdb.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eed03e5ff5639e09"}},{"code_sha256_prefix":"c5976b5c715825f6","entry":"replace_inf_to_zero","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/instant.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/instant.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c5976b5c715825f6"}},{"code_sha256_prefix":"4c0668013863ad3f","entry":"resize_pos_embed_vit","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/nets/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/nets/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c0668013863ad3f"}},{"code_sha256_prefix":"05dda2f18675eb59","entry":"select_data","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"preprocess/preprocess_aclimdb.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/preprocess/preprocess_aclimdb.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05dda2f18675eb59"}},{"code_sha256_prefix":"0d7ccb1ebe8542c9","entry":"forward_loss","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/algorithms/instant/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/algorithms/instant/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0d7ccb1ebe8542c9"}},{"code_sha256_prefix":"b158ea331635a6c9","entry":"load_checkpoint","repo":"tmllab/2023_NeurIPS_InstanT","repo_kind":"listed","path":"semilearn/nets/utils.py","file_url":"https://github.com/tmllab/2023_NeurIPS_InstanT/blob/HEAD/semilearn/nets/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b158ea331635a6c9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}