{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/all-labels-are-not-created-equal-enhancing","title":"All Labels Are Not Created Equal: Enhancing Semi-supervision via Label Grouping and Co-training","arxiv_id":"2104.05248","date":"2021-04-12","proceeding":"CVPR 2021 1","authors":["Islam Nassar","Samitha Herath","Ehsan Abbasnejad","Wray Buntine","Gholamreza Haffari"],"abstract":"Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they only rely on the model's prediction to make labeling decisions without considering any prior knowledge about the visual similarity among the classes. In this paper, we demonstrate that this degrades the quality of pseudo-labeling as it poorly represents visually similar classes in the pool of pseudo-labeled data. We propose SemCo, a method which leverages label semantics and co-training to address this problem. We train two classifiers with two different views of the class labels: one classifier uses the one-hot view of the labels and disregards any potential similarity among the classes, while the other uses a distributed view of the labels and groups potentially similar classes together. We then co-train the two classifiers to learn based on their disagreements. We show that our method achieves state-of-the-art performance across various SSL tasks including 5.6% accuracy improvement on Mini-ImageNet dataset with 1000 labeled examples. We also show that our method requires smaller batch size and fewer training iterations to reach its best performance. We make our code available at https://github.com/islam-nassar/semco.","url_abs":"https://arxiv.org/abs/2104.05248v1","url_pdf":"https://arxiv.org/pdf/2104.05248v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"all-labels-are-not-created-equal-enhancing","repo_url":"https://github.com/islam-nassar/semco","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"semi-supervised-image-classification","task_name":"Semi-Supervised Image Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/semi-supervised-image-classification-on-cifar","task":"Semi-Supervised Image Classification","dataset":"CIFAR-10, 4000 Labels","model":"SemCo (μ=7)","rank_in_archive_order":4,"of":49,"metrics":{"Percentage error":"3.8±0.08"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini-2","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 1000 Labels","model":"SemCo (μ=3)","rank_in_archive_order":2,"of":3,"metrics":{"Accuracy":"44.65±0.71"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini-2","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 1000 Labels","model":"SemCo (μ=7)","rank_in_archive_order":3,"of":3,"metrics":{"Accuracy":"40.65±0.23"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini-1","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 10000 Labels","model":"SemCo (μ=3)","rank_in_archive_order":2,"of":3,"metrics":{"Accuracy":"58.75±0.76"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini-1","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 10000 Labels","model":"SemCo (μ=7)","rank_in_archive_order":3,"of":3,"metrics":{"Accuracy":"57.22±0.35"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 4000 Labels","model":"SemCo (μ=3)","rank_in_archive_order":3,"of":4,"metrics":{"Accuracy":"53.99±0.93"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-mini","task":"Semi-Supervised Image Classification","dataset":"Mini-ImageNet, 4000 Labels","model":"SemCo (μ=7)","rank_in_archive_order":4,"of":4,"metrics":{"Accuracy":"50.54±2.20"},"uses_additional_data":false},{"leaderboard":"/sota/semi-supervised-image-classification-on-cifar-2","task":"Semi-Supervised Image Classification","dataset":"cifar-100, 10000 Labels","model":"SemCo (μ=7)","rank_in_archive_order":21,"of":29,"metrics":{"Percentage error":"24.45±0.12"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2104.05248","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}