Semantic Retrieval

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

3 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

26 shown of 26 papers with code (86 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
  24 Aug 2023 2 repositories listed
  In this work, we use a multilingual knowledge distillation approach to train BERT models to produce sentence embeddings for Ancient Greek text.
• MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval
  2 Jul 2023 2 repositories listed
  In response, we introduce MedCPT, a first-of-its-kind Contrastively Pre-trained Transformer model for zero-shot semantic IR in biomedicine.
• Revealing the Importance of Semantic Retrieval for Machine Reading at Scale
  17 Sep 2019 2 repositories listed Syntology ran 6 of 17 samples · 11 unverified
  In this work, we give general guidelines on system design for MRS by proposing a simple yet effective pipeline system with special consideration on hierarchical semantic retrieval at both paragraph and sentence level,…
• HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databases
  21 May 2025 1 repository listed
  Large Language Models (LLMs) have demonstrated their potential in hardware design tasks, such as Hardware Description Language (HDL) generation and debugging.
• AnDB: Breaking Boundaries with an AI-Native Database for Universal Semantic Analysis
  19 Feb 2025 1 repository listed
  In this demonstration, we present AnDB, an AI-native database that supports traditional OLTP workloads and innovative AI-driven tasks, enabling unified semantic analysis across structured and unstructured data.
• Multimodal semantic retrieval for product search
  13 Jan 2025 1 repository listed
  Semantic retrieval (also known as dense retrieval) based on textual data has been extensively studied for both web search and product search application fields, where the relevance of a query and a potential target…
• SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  13 Dec 2024 1 repository listed
  To address these challenges, optimizations for long-context inference have been developed, centered around the KV cache.
• APTNESS: Incorporating Appraisal Theory and Emotion Support Strategies for Empathetic Response Generation
  23 Jul 2024 1 repository listed
  By incorporating emotional support strategies, we aim to enrich the model's capabilities in both cognitive and affective empathy, leading to a more nuanced and comprehensive empathetic response.
• GLARE: Low Light Image Enhancement via Generative Latent Feature based Codebook Retrieval
  17 Jul 2024 1 repository listed
  Most existing Low-light Image Enhancement (LLIE) methods either directly map Low-Light (LL) to Normal-Light (NL) images or use semantic or illumination maps as guides.
• MINERS: Multilingual Language Models as Semantic Retrievers
  11 Jun 2024 1 repository listed Syntology ran 9 of 10 samples · 1 unverified
  Words have been represented in a high-dimensional vector space that encodes their semantic similarities, enabling downstream applications such as retrieving synonyms, antonyms, and relevant contexts.
• LLM Based Multi-Agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain
  21 Feb 2024 1 repository listed
  In the last years' digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse.
• M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  30 Oct 2023 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  In this paper, we propose M4LE, a Multi-ability, Multi-range, Multi-task, Multi-domain benchmark for Long-context Evaluation.
• If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History
  16 Oct 2023 1 repository listed
  We demonstrate that LLMs semantic retrieval and reasoning abilities on problem-specific tasks can be applied to large textual archives that have not been part of the its training data.
• Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models
  25 May 2023 1 repository listed
  Inspired by this, we replace the semantic retrieval in Retro with a surface-level method based on BM25, obtaining a significant reduction in perplexity.
• Intra-class Adaptive Augmentation with Neighbor Correction for Deep Metric Learning
  29 Nov 2022 1 repository listed
  They have overlooked the wide characteristic changes of different classes and can not model abundant intra-class variations for generations.
• Sentence Representation Learning with Generative Objective rather than Contrastive Objective
  16 Oct 2022 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  Though offering amazing contextualized token-level representations, current pre-trained language models take less attention on accurately acquiring sentence-level representation during their self-supervised pre-training.
• Training Effective Neural Sentence Encoders from Automatically Mined Paraphrases
  26 Jul 2022 1 repository listed
  Our sentence encoder can be trained in less than a day on a single graphics card, achieving high performance on a diverse set of sentence-level tasks.
• PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search
  19 Jul 2022 1 repository listed
  While contextualized word embeddings have been a de-facto standard, learning contextualized phrase embeddings is less explored and being hindered by the lack of a human-annotated benchmark that tests machine…
• Variational Transformer: A Framework Beyond the Trade-off between Accuracy and Diversity for Image Captioning
  28 May 2022 1 repository listed
  In this work, we will show that the inferior standard of accuracy draws from human annotations (leave-one-out) are not appropriate for machine-generated captions.
• Semantic Information Recovery in Wireless Networks
  28 Apr 2022 1 repository listed
  Thus, we model semantics by means of hidden random variables and define the semantic communication task as the data-reduced and reliable transmission of messages over a communication channel such that semantics is best…
• Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation
  15 Mar 2022 1 repository listed
  How to learn highly compact yet effective sentence representation?
• Evaluation of Audio-Visual Alignments in Visually Grounded Speech Models
  5 Jul 2021 1 repository listed
  We compare the alignment performance using our proposed evaluation metrics to the semantic retrieval task commonly used to evaluate VGS models.
• Semantic Models for the First-stage Retrieval: A Comprehensive Review
  8 Mar 2021 1 repository listed
  We believe it is the right time to survey current status, learn from existing methods, and gain some insights for future development.
• Deep Unsupervised Image Hashing by Maximizing Bit Entropy
  22 Dec 2020 1 repository listed
  This layer is shown to minimize a penalized term of the Wasserstein distance between the learned continuous image features and the optimal half-half bit distribution.
• Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines
  10 Nov 2019 1 repository listed
  We propose a new shared task of semantic retrieval from legal texts, in which a so-called contract discovery is to be performed, where legal clauses are extracted from documents, given a few examples of similar clauses…
• Semantic query-by-example speech search using visual grounding
  15 Apr 2019 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  A number of recent studies have started to investigate how speech systems can be trained on untranscribed speech by leveraging accompanying images at training time.

Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.