{"url":"/sota/image-retrieval-on-coco","task":{"name":"Image Retrieval","url":"/task/image-retrieval","note":null},"dataset":{"name":"COCO (Common Objects in Context)","url":"/dataset/coco"},"category":"Computer Vision","categories":["Computer Vision"],"category_note":null,"description":"**Image Retrieval** is a fundamental and long-standing computer vision task that involves finding images similar to a given query from a large database. It is often considered a form of fine-grained, instance-level classification. The task is integral to image recognition alongside [classification](/task/image-classification) and [cross-modal retrieval](/task/cross-modal-retrieva). By leveraging visual similarity and other criteria, image retrieval enables users to efficiently discover relevant images, making it a crucial tool in applications such as search and recommendation.\r\n\r\n<span class=\"description-source\">[Extending CLIP for Category-to-image Retrieval in E-commerce](https://arxiv.org/abs/2112.11294)</span>\r\n\r\n<span style=\"color:grey; opacity: 0.6\">( Image credit: [DELF](https://github.com/tensorflow/models/tree/master/research/delf) )</span>","description_from":"task","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","rank":"the archive's row order at snapshot; not re-ranked","rows_end_at":"2025-07-28","rows_withheld_as_spam":0,"metric_values":"the archive's strings, untouched"},"metrics":["recall@1","recall@5","Recall@10","QPS"],"metric_direction":{"note":"inferred from the metric name only (the archive records no direction); null = not inferred, chart draws points only","by_metric":{"recall@1":"higher","recall@5":"higher","Recall@10":"higher","QPS":null}},"counts":{"rows":6,"rows_with_code":6,"rows_with_paper_page":6,"rows_dated":6,"rows_using_additional_data":0},"rows":[{"rank_in_archive_order":1,"model":"BLIP-2 ViT-G (fine-tuned)","metrics":{"Recall@10":"92.6","recall@1":"68.3","recall@5":"87.7"},"uses_additional_data":false,"paper_date":"2023-01-30","paper":"/paper/blip-2-bootstrapping-language-image-pre","paper_url":"https://arxiv.org/abs/2301.12597v3","paper_title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","code":"https://github.com/huggingface/transformers","n_code_links":17,"syntology":{"n_ran":4,"n_unverified":4,"n_samples":8,"n_pointer_only_licence":1}},{"rank_in_archive_order":2,"model":"VisualSparta","metrics":{"QPS":"451.4","Recall@10":"96.3","recall@1":"68.2","recall@5":"91.8"},"uses_additional_data":false,"paper_date":"2021-01-01","paper":"/paper/visualsparta-sparse-transformer-fragment","paper_url":"https://arxiv.org/abs/2101.00265v2","paper_title":"VisualSparta: An Embarrassingly Simple Approach to Large-scale Text-to-Image Search with Weighted Bag-of-words","code":"https://github.com/soco-ai/SF-QA","n_code_links":1,"syntology":null},{"rank_in_archive_order":3,"model":"BLIP-2 ViT-L (fine-tuned)","metrics":{"Recall@10":"91.8","recall@1":"66.3","recall@5":"86.5"},"uses_additional_data":false,"paper_date":"2023-01-30","paper":"/paper/blip-2-bootstrapping-language-image-pre","paper_url":"https://arxiv.org/abs/2301.12597v3","paper_title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","code":"https://github.com/huggingface/transformers","n_code_links":17,"syntology":{"n_ran":4,"n_unverified":4,"n_samples":8,"n_pointer_only_licence":1}},{"rank_in_archive_order":4,"model":"FLAVA (zero-shot)","metrics":{"recall@1":"38.38","recall@5":"67.47"},"uses_additional_data":false,"paper_date":"2021-12-08","paper":"/paper/flava-a-foundational-language-and-vision","paper_url":"https://arxiv.org/abs/2112.04482v3","paper_title":"FLAVA: A Foundational Language And Vision Alignment Model","code":"https://github.com/facebookresearch/multimodal","n_code_links":4,"syntology":null},{"rank_in_archive_order":5,"model":"CLIP (zero-shot)","metrics":{"recall@1":"33.29","recall@5":"62.47"},"uses_additional_data":false,"paper_date":"2021-12-08","paper":"/paper/flava-a-foundational-language-and-vision","paper_url":"https://arxiv.org/abs/2112.04482v3","paper_title":"FLAVA: A Foundational Language And Vision Alignment Model","code":"https://github.com/facebookresearch/multimodal","n_code_links":4,"syntology":null},{"rank_in_archive_order":6,"model":"Oscar","metrics":{"Recall@10":"98.3"},"uses_additional_data":false,"paper_date":"2020-04-13","paper":"/paper/oscar-object-semantics-aligned-pre-training","paper_url":"https://arxiv.org/abs/2004.06165v5","paper_title":"Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks","code":"https://github.com/rmokady/clip_prefix_caption","n_code_links":4,"syntology":{"n_ran":11,"n_unverified":12,"n_samples":23,"n_pointer_only_licence":0}}],"since_archive":{"present":false,"note":"No Syntology-extracted rows are published in this build."},"syntology":{"read_at":"2026-09-24T18:15:14+00:00","claim":"Per row: N of M harvested code samples from that row's paper executed on a synthesized fixture; the other M-N are unverified. Not a reproduction of the row's number; not a correctness claim. n_pointer_only_licence counts samples the site points at rather than redistributes (a licence axis, independent of ran/unverified).","rows_with_graph_line":3,"rows_with_any_sample_ran":3,"distinct_papers_with_graph_line":2,"distinct_papers_with_any_sample_ran":2,"samples_over_distinct_papers":{"n_ran":15,"n_unverified":16,"n_samples":31,"n_pointer_only_licence":1,"note":"each paper (arXiv id) counted once, however many rows it is behind; this is the page-level figure"},"samples_row_weighted":{"n_ran":19,"n_unverified":20,"n_samples":39,"n_pointer_only_licence":2,"note":"row-weighted: a paper behind several rows is counted once per row; inflated relative to samples_over_distinct_papers by design, kept for readers summing the per-row syntology blocks"}}}