{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/partially-view-aligned-representation","title":"Partially View-aligned Representation Learning with Noise-robust Contrastive Loss","arxiv_id":null,"date":"2021-03-01","proceeding":"CVPR 2021 1","authors":["Mouxing Yang","Yunfan Li","Zhenyu Huang","Zitao Liu","Peng Hu","Xi Peng"],"abstract":"In real-world applications, it is common that only a portion of data is aligned across views due to spatial, temporal, or spatiotemporal asynchronism, thus leading to socalled Partially View-aligned Problem (PVP). To solve such a less-touched problem without the help of labels, we propose simultaneously learning representation and aligning data using a noise-robust contrastive loss. In brief, for each sample from one view, our method aims to identify its within-category counterparts from other views, and thus the cross-view correspondence could be established. As the contrastive learning needs data pairs as input, we construct positive pairs using the known correspondences and negative pairs using random sampling. To alleviate or even eliminate the influence of the false negatives caused by random sampling, we propose a noise-robust contrastive loss which could adaptively prevent the false negatives from dominating the network optimization. Different from the Hungarian algorithm and its variants, our solution to PVP aims to achieve category- instead of instance-level alignment. Thanks to the higher accessibility and scalability of the category-level alignment, it is more desirable for the tasks such as clustering and classification. In addition, to the best of our knowledge, this could be the first successful attempt of enabling contrastive learning robust to noisy labels. Extensive experiments show the promising performance of our method comparing with 10 state-of-the-art multi-view approaches in the clustering and classification tasks.","url_abs":"http://pengxi.me/wp-content/uploads/2021/03/2021CVPR-MvCLNwith-supp.pdf","url_pdf":"http://pengxi.me/wp-content/uploads/2021/03/2021CVPR-MvCLNwith-supp.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"partially-view-aligned-representation","repo_url":"https://github.com/XLearning-SCU/2021-CVPR-MvCLN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"partially-view-aligned-multi-view-learning","task_name":"Partially View-aligned Multi-view Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[{"method_slug":"contrastive-learning","method_name":"Contrastive Learning"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/partially-view-aligned-multi-view-learning-on-1","task":"Partially View-aligned Multi-view Learning","dataset":"Caltech101","model":"MvCLN","rank_in_archive_order":1,"of":1,"metrics":{"NMI":"43.07"},"uses_additional_data":false},{"leaderboard":"/sota/partially-view-aligned-multi-view-learning-on-4","task":"Partially View-aligned Multi-view Learning","dataset":"Reuters En-Fr","model":"MvCLN","rank_in_archive_order":1,"of":1,"metrics":{"NMI":"30.65"},"uses_additional_data":false},{"leaderboard":"/sota/partially-view-aligned-multi-view-learning-on-2","task":"Partially View-aligned Multi-view Learning","dataset":"Scene-15","model":"MvCLN","rank_in_archive_order":1,"of":1,"metrics":{"NMI":"39.90"},"uses_additional_data":false},{"leaderboard":"/sota/partially-view-aligned-multi-view-learning-on","task":"Partially View-aligned Multi-view Learning","dataset":"n-MNIST","model":"MvCLN","rank_in_archive_order":1,"of":1,"metrics":{"NMI":"93.09"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}