Papers › Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotations

Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotations

3 Jun 2023arXiv:2306.02092archive 2025-07-28

Xu Zhang, Zhedong Zheng, Linchao Zhu, Yi Yang

Composed image retrieval extends content-based image retrieval systems by enabling users to search using reference images and captions that describe their intention. Despite great progress in developing image-text compositors to extract discriminative visual-linguistic features, we identify a hitherto overlooked issue, triplet ambiguity, which impedes robust feature extraction. Triplet ambiguity refers to a type of semantic ambiguity that arises between the reference image, the relative caption, and the target image. It is mainly due to the limited representation of the annotated text, resulting in many noisy triplets where multiple visually dissimilar candidate images can be matched to an identical reference pair (i.e., a reference image + a relative caption). To address this challenge, we propose the Consensus Network (Css-Net), inspired by the psychological concept that groups outperform individuals. Css-Net comprises two core components: (1) a consensus module with four diverse compositors, each generating distinct image-text embeddings, fostering complementary feature extraction and mitigating dependence on any single, potentially biased compositor; (2) a Kullback-Leibler divergence loss that encourages learning of inter-compositor interactions to promote consensual outputs. During evaluation, the decisions of the four compositors are combined through a weighting scheme, enhancing overall agreement. On benchmark datasets, particularly FashionIQ, Css-Net demonstrates marked improvements. Notably, it achieves significant recall gains, with a 2.77% increase in R@10 and 6.67% boost in R@50, underscoring its competitiveness in addressing the fundamental limitations of existing methods.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Content-Based Image RetrievalImage RetrievalImage Retrieval with Multi-Modal QueryRetrieval

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Retrieval Fashion IQ Css-Net (Recall@10+Recall@50)/2 51.34 #12 of 22 Archive leaderboard report
Image Retrieval with Multi-Modal Query Fashion200k Css-Net Recall@1 23.4 #1 of 8 Archive leaderboard report
Image Retrieval with Multi-Modal Query Fashion200k Css-Net Recall@10 52.0 #1 of 8 Archive leaderboard report
Image Retrieval with Multi-Modal Query Fashion200k Css-Net Recall@50 72.0 #1 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Focus

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections