{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-with-noisy-correspondence","title":"Learning with Noisy Correspondence","arxiv_id":null,"date":"2024-04-13","proceeding":"International Journal of Computer Vision 2024 4","authors":["Zhenyu Huang","Peng Hu","guocheng niu","Xinyan Xiao","Jiancheng Lv","Xi Peng"],"abstract":"This paper studies a new learning paradigm for noisy labels, i.e., noisy correspondence (NC). Unlike the well-studied noisy labels that consider the errors in the category annotation of a sample, the NC refers to the errors in the alignment relationship of two data points. Although such false positive pairs are common especially in the data harvested from the Internet, which however are neglected by most existing works. By taking cross-modal retrieval as a showcase, we propose a method called learning with noisy correspondence (LNC). In brief, the LNC first roughly obtains the clean and noisy subsets from the original data and then rectifies the false positive pairs by using a novel adaptive prediction function. Finally, the LNC adopts a novel triplet loss with soft margins to endow cross-modal retrieval the robustness to the NC. To verify the effectiveness of the proposed LNC, we conduct experiments on six benchmark datasets in image-text and video-text retrieval tasks. Besides the effectiveness of the LNC, the experimental results show the necessity of the explicit solution to the NC faced by not only the standard model training paradigm but also the pre-training and fine-tuning paradigms.","url_abs":"https://link.springer.com/article/10.1007/s11263-024-02064-0","url_pdf":"https://link.springer.com/article/10.1007/s11263-024-02064-0","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"cross-modal-retrieval","task_name":"Cross-Modal Retrieval"},{"task_slug":"cross-modal-retrieval-with-noisy","task_name":"Cross-modal retrieval with noisy correspondence"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"text-retrieval","task_name":"Text Retrieval"},{"task_slug":null,"task_name":"Triplet"},{"task_slug":"video-text-retrieval","task_name":"Video-Text Retrieval"}],"methods":[{"method_slug":"triplet-loss","method_name":"Triplet Loss"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/cross-modal-retrieval-with-noisy-1","task":"Cross-modal retrieval with noisy correspondence","dataset":"CC152K","model":"LNC","rank_in_archive_order":15,"of":15,"metrics":{"Image-to-text R@1":"39.5","Image-to-text R@10":"73.1","Image-to-text R@5":"64.0","R-Sum":"355.5","Text-to-image R@1":"40.6","Text-to-image R@10":"73.5","Text-to-image R@5":"64.8"},"uses_additional_data":false},{"leaderboard":"/sota/cross-modal-retrieval-with-noisy-3","task":"Cross-modal retrieval with noisy correspondence","dataset":"COCO-Noisy","model":"LNC","rank_in_archive_order":14,"of":17,"metrics":{"Image-to-text R@1":"78.2","Image-to-text R@10":"98.5","Image-to-text R@5":"95.8","R-Sum":"519.9","Text-to-image R@1":"62.6","Text-to-image R@10":"95.4","Text-to-image R@5":"89.4"},"uses_additional_data":false},{"leaderboard":"/sota/cross-modal-retrieval-with-noisy-2","task":"Cross-modal retrieval with noisy correspondence","dataset":"Flickr30K-Noisy","model":"LNC","rank_in_archive_order":13,"of":16,"metrics":{"Image-to-text R@1":"76.3","Image-to-text R@10":"96.9","Image-to-text R@5":"93.7","R-Sum":"498.9","Text-to-image R@1":"58.4","Text-to-image R@10":"89.8","Text-to-image R@5":"83.8"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}