Papers › UGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal Matching

UGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal Matching

11 Jul 2024SIGIR 2024 7archive 2025-07-28

Quanxing Zha, Xin Liu, Yiu-ming Cheung, Xing Xu, Nannan Wang, Jianjia Cao

Cross-modal matching has recently gained significant popularity to facilitate retrieval across multi-modal data, and existing works are highly relied on an implicit assumption that the training data pairs are perfectly aligned. However, such an ideal assumption is extremely impossible due to the inevitably mismatched data pairs, a.k.a. noisy correspondence, which can wrongly enforce the mismatched data to be similar and thus induces the performance degradation. Although some recent methods have attempted to address this problem, they still face two challenging issues: 1) un- reliable data division for training inefficiency and 2) unstable pre- diction for matching failure. To address these problems, we pro- pose an efficient Uncertainty-Guided Noisy Correspondence Learning (UGNCL) framework to achieve noise-robust cross-modal matching. Specifically, a novel Uncertainty Guided Division (UGD) algorithm is reliably designed leverage the potential benefits of derived un- certainty to divide the data into clean, noisy and hard partitions, which can effortlessly mitigate the impact of easily-determined noisy pairs. Meanwhile, an efficient Trusted Robust Loss (TRL) is explicitly designed to recast the soft margins, calibrated by confi- dent yet error soft correspondence labels, for the data pairs in the hard partition through the uncertainty, leading to increase/decrease the importance of matched/mismatched pairs and further alleviate the impact of noisy pairs for robustness improvement. Extensive experiments conducted on three public datasets highlight the su- periorities of the proposed framework, and show its competitive performance compared with the state-of-the-arts. The code is avail- able at https://github.com/qxzha/UGNCL.

PaperPDFCode

Code

qxzha/UGNCL officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceImage-text RetrievalImage-text matching

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Cross-modal retrieval with noisy correspondence CC152K UGNCL Image-to-text R@1 43.6 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL Image-to-text R@10 74.9 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL Image-to-text R@5 67.1 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL R-Sum 373.1 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL Text-to-image R@1 42.7 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL Text-to-image R@10 76.4 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence CC152K UGNCL Text-to-image R@5 68.4 #6 of 15 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Image-to-text R@1 79.5 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Image-to-text R@10 99.0 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Image-to-text R@5 97.2 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL R-Sum 526.3 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Text-to-image R@1 63.7 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Text-to-image R@10 96.0 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence COCO-Noisy UGNCL Text-to-image R@5 90.9 #3 of 17 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Image-to-text R@1 78.4 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Image-to-text R@10 97.8 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Image-to-text R@5 95.8 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL R-Sum 505.6 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Text-to-image R@1 59.8 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Text-to-image R@10 89.5 #7 of 16 Archive leaderboard report
Cross-modal retrieval with noisy correspondence Flickr30K-Noisy UGNCL Text-to-image R@5 84.3 #7 of 16 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections