{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hyperspherical-consistency-regularization","title":"Hyperspherical Consistency Regularization","arxiv_id":"2206.00845","date":"2022-06-02","proceeding":"CVPR 2022 1","authors":["Cheng Tan","Zhangyang Gao","Lirong Wu","Siyuan Li","Stan Z. Li"],"abstract":"Recent advances in contrastive learning have enlightened diverse applications across various semi-supervised fields. Jointly training supervised learning and unsupervised learning with a shared feature encoder becomes a common scheme. Though it benefits from taking advantage of both feature-dependent information from self-supervised learning and label-dependent information from supervised learning, this scheme remains suffering from bias of the classifier. In this work, we systematically explore the relationship between self-supervised learning and supervised learning, and study how self-supervised learning helps robust data-efficient deep learning. We propose hyperspherical consistency regularization (HCR), a simple yet effective plug-and-play method, to regularize the classifier using feature-dependent information and thus avoid bias from labels. Specifically, HCR first projects logits from the classifier and feature projections from the projection head on the respective hypersphere, then it enforces data points on hyperspheres to have similar structures by minimizing binary cross entropy of pairwise distances' similarity metrics. Extensive experiments on semi-supervised and weakly-supervised learning demonstrate the effectiveness of our method, by showing superior performance with HCR.","url_abs":"https://arxiv.org/abs/2206.00845v1","url_pdf":"https://arxiv.org/pdf/2206.00845v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hyperspherical-consistency-regularization","repo_url":"https://github.com/chengtan9907/Hyperspherical-Consistency-Regularization","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"hyperspherical-consistency-regularization","repo_url":"https://github.com/MindCode-4/code-12/tree/main/hyperspherical-consistency-regularization","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"hyperspherical-consistency-regularization","repo_url":"https://github.com/MindCode-4/code-7/tree/main/hyperspherical-consistency-regularization","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"hyperspherical-consistency-regularization","repo_url":"https://github.com/MindSpore-scientific-2/code-12/tree/main/hyperspherical-consistency-regularization","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"hyperspherical-consistency-regularization","repo_url":"https://github.com/nanzhaogang/contrib/tree/master/application/hyperspherical-consistency-regularization","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"weakly-supervised-learning","task_name":"Weakly-supervised Learning"}],"methods":[{"method_slug":"contrastive-learning","method_name":"Contrastive Learning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2206.00845","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.00845"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-7/tree/main/hyperspherical-consistency-regularization","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chengtan9907/Hyperspherical-Consistency-Regularization","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-12/tree/main/hyperspherical-consistency-regularization","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nanzhaogang/contrib/tree/master/application/hyperspherical-consistency-regularization","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindSpore-scientific-2/code-12/tree/main/hyperspherical-consistency-regularization","reach":null}],"summary":{"ran":1,"ran_violates":1,"ran_honours":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1},"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"75a68fe5bfb6b30f","entry":"HCR","repo":"chengtan9907/Hyperspherical-Consistency-Regularization","repo_kind":"official","path":"hcr.py","file_url":"https://github.com/chengtan9907/Hyperspherical-Consistency-Regularization/blob/HEAD/hcr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"75a68fe5bfb6b30f"}},{"code_sha256_prefix":"aa5486a3650902d8","entry":"exists","repo":"nanzhaogang/contrib","repo_kind":"listed","path":"application/Adaptive-Nesterov-Momentum-Algorithm/adan.py","file_url":"https://github.com/nanzhaogang/contrib/blob/HEAD/application/Adaptive-Nesterov-Momentum-Algorithm/adan.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa5486a3650902d8"}},{"code_sha256_prefix":"5e2ed23acb71ee11","entry":"noop","repo":"nanzhaogang/contrib","repo_kind":"listed","path":"application/Fixup-Initialization/model_build.py","file_url":"https://github.com/nanzhaogang/contrib/blob/HEAD/application/Fixup-Initialization/model_build.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5e2ed23acb71ee11"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}