{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-consistency-regularization-for-semi","title":"Adaptive Consistency Regularization for Semi-Supervised Transfer Learning","arxiv_id":"2103.02193","date":"2021-03-03","proceeding":"CVPR 2021 1","authors":["Abulikemu Abuduweili","Xingjian Li","Humphrey Shi","Cheng-Zhong Xu","Dejing Dou"],"abstract":"While recent studies on semi-supervised learning have shown remarkable progress in leveraging both labeled and unlabeled data, most of them presume a basic setting of the model is randomly initialized. In this work, we consider semi-supervised learning and transfer learning jointly, leading to a more practical and competitive paradigm that can utilize both powerful pre-trained models from source domain as well as labeled/unlabeled data in the target domain. To better exploit the value of both pre-trained weights and unlabeled target examples, we introduce adaptive consistency regularization that consists of two complementary components: Adaptive Knowledge Consistency (AKC) on the examples between the source and target model, and Adaptive Representation Consistency (ARC) on the target model between labeled and unlabeled examples. Examples involved in the consistency regularization are adaptively selected according to their potential contributions to the target task. We conduct extensive experiments on popular benchmarks including CIFAR-10, CUB-200, and MURA, by fine-tuning the ImageNet pre-trained ResNet-50 model. Results show that our proposed adaptive consistency regularization outperforms state-of-the-art semi-supervised learning techniques such as Pseudo Label, Mean Teacher, and FixMatch. Moreover, our algorithm is orthogonal to existing methods and thus able to gain additional improvements on top of MixMatch and FixMatch. Our code is available at https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning.","url_abs":"https://arxiv.org/abs/2103.02193v2","url_pdf":"https://arxiv.org/pdf/2103.02193v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adaptive-consistency-regularization-for-semi","repo_url":"https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"arc","task_name":"ARC"},{"task_slug":"pseudo-label","task_name":"Pseudo Label"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[{"method_slug":"fixmatch","method_name":"FixMatch"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.02193","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.02193"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/Walleclipse/Semi-Supervised-Transfer-Learning-Paddle","reach":{"status":"unanswered"}}],"summary":{"ran_draft_wrong":1,"ran_honours":1,"ran_fixture":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"58296ac0e951d61d","entry":"compute_kernel","repo":"SHI-Labs/Semi-Supervised-Transfer-Learning","repo_kind":"official","path":"code/ssl_lib/consistency/regularizer.py","file_url":"https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning/blob/HEAD/code/ssl_lib/consistency/regularizer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"58296ac0e951d61d"}},{"code_sha256_prefix":"f30b2b2f9f8e3a95","entry":"mmd_loss","repo":"SHI-Labs/Semi-Supervised-Transfer-Learning","repo_kind":"official","path":"code/ssl_lib/consistency/regularizer.py","file_url":"https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning/blob/HEAD/code/ssl_lib/consistency/regularizer.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f30b2b2f9f8e3a95"}},{"code_sha256_prefix":"7d71fa305f0872f8","entry":"reg_MMD","repo":"SHI-Labs/Semi-Supervised-Transfer-Learning","repo_kind":"official","path":"code/ssl_lib/consistency/regularizer.py","file_url":"https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning/blob/HEAD/code/ssl_lib/consistency/regularizer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d71fa305f0872f8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}