{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-the-effectiveness-of-supervision-in","title":"On the Effectiveness of Supervision in Asymmetric Non-Contrastive Learning","arxiv_id":"2406.10815","date":"2024-06-16","proceeding":null,"authors":["Jeongheon Oh","Kibok Lee"],"abstract":"Supervised contrastive representation learning has been shown to be effective in various transfer learning scenarios. However, while asymmetric non-contrastive learning (ANCL) often outperforms its contrastive learning counterpart in self-supervised representation learning, the extension of ANCL to supervised scenarios is less explored. To bridge the gap, we study ANCL for supervised representation learning, coined SupSiam and SupBYOL, leveraging labels in ANCL to achieve better representations. The proposed supervised ANCL framework improves representation learning while avoiding collapse. Our analysis reveals that providing supervision to ANCL reduces intra-class variance, and the contribution of supervision should be adjusted to achieve the best performance. Experiments demonstrate the superiority of supervised ANCL across various datasets and tasks. The code is available at: https://github.com/JH-Oh-23/Sup-ANCL.","url_abs":"https://arxiv.org/abs/2406.10815v1","url_pdf":"https://arxiv.org/pdf/2406.10815v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-the-effectiveness-of-supervision-in","repo_url":"https://github.com/jh-oh-23/sup-ancl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[{"method_slug":"contrastive-learning","method_name":"Contrastive Learning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2406.10815","atlas_url":"https://app.syntology.ai/?focus=2406.10815","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.10815"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/JH-Oh-23/Sup-ANCL","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jh-oh-23/sup-ancl","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"ran_draft_wrong":2,"ran_fixture":3,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4c31d26574c40b3b","entry":"SupSiam","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"builder.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/builder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c31d26574c40b3b"}},{"code_sha256_prefix":"27cea26b98b9aebe","entry":"build_step","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"transfer.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/transfer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"27cea26b98b9aebe"}},{"code_sha256_prefix":"4eb65fa0ebc8a3bc","entry":"collect_features","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"transfer.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/transfer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4eb65fa0ebc8a3bc"}},{"code_sha256_prefix":"48afbec326335e94","entry":"compute_accuracy","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"transfer.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/transfer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48afbec326335e94"}},{"code_sha256_prefix":"301ca971eacdfdcb","entry":"train","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"linear.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/linear.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"301ca971eacdfdcb"}},{"code_sha256_prefix":"46c53e9b88a51bc9","entry":"validate","repo":"jh-oh-23/sup-ancl","repo_kind":"official","path":"linear.py","file_url":"https://github.com/jh-oh-23/sup-ancl/blob/HEAD/linear.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46c53e9b88a51bc9"}},{"code_sha256_prefix":"73cecca9f3575f09","entry":"concat_all_gather","repo":"JH-Oh-23/Sup-ANCL","repo_kind":"official","path":"builder.py","file_url":"https://github.com/JH-Oh-23/Sup-ANCL/blob/HEAD/builder.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"73cecca9f3575f09"}},{"code_sha256_prefix":"37a474354ef19bfa","entry":"load_fewshot_datasets","repo":"JH-Oh-23/Sup-ANCL","repo_kind":"official","path":"fewshot.py","file_url":"https://github.com/JH-Oh-23/Sup-ANCL/blob/HEAD/fewshot.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"37a474354ef19bfa"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}