Semantic Similarity

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

27 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 27 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

17 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 534 papers with code (1,564 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
  27 Aug 2019 64 repositories listed Syntology ran 20 of 58 samples · 38 unverified · 11 pointer-only (licence)
  However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10, 000 sentences requires about 50 million inference…
• ERNIE: Enhanced Representation through Knowledge Integration
  19 Apr 2019 19 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
• Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
  28 Feb 2015 16 repositories listed Syntology ran 6 of 15 samples · 9 unverified · 6 pointer-only (licence)
  Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong…
• Improving Language Understanding by Generative Pre-Training
  11 Jun 2018 13 repositories listed
  We demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
• Language-agnostic BERT Sentence Embedding
  3 Jul 2020 6 repositories listed
  While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings…
• MedSTS: A Resource for Clinical Semantic Textual Similarity
  28 Aug 2018 5 repositories listed
  A subset of MedSTS (MedSTS_ann) containing 1, 068 sentence pairs was annotated by two medical experts with semantic similarity scores of 0-5 (low to high similarity).
• Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets
  13 Jun 2019 4 repositories listed Syntology ran 0 of 2 samples · 2 unverified
• Calculating the similarity between words and sentences using a lexical database and corpus statistics
  15 Feb 2018 4 repositories listed
  To calculate the semantic similarity between words and sentences, the proposed method follows an edge-based approach using a lexical database.
• DataSculpt: Crafting Data Landscapes for Long-Context LLMs through Multi-Objective Partitioning
  2 Sep 2024 3 repositories listed
  Through extensive experimental analysis, we identified three key challenges in designing effective data management strategies that enable the model to achieve long-context capability without sacrificing performance in…
• On Semantic Similarity in Video Retrieval
  18 Mar 2021 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Current video retrieval efforts all found their evaluation on an instance-based assumption, that only a single caption is relevant to a query video and vice versa.
• Generating Natural Language Attacks in a Hard Label Black Box Setting
  29 Dec 2020 3 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 6 pointer-only (licence)
  Our proposed attack strategy leverages population-based optimization algorithm to craft plausible and semantically similar adversarial examples by observing only the top label predicted by the target model.
• On the Sentence Embeddings from Pre-trained Language Models
  2 Nov 2020 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Pre-trained contextual representations like BERT have achieved great success in natural language processing.
• Semantic Relatedness Based Re-ranker for Text Spotting
  17 Sep 2019 3 repositories listed
  We present a scenario where semantic similarity is not enough, and we devise a neural approach to learn semantic relatedness.
• A Hybrid Neural Network Model for Commonsense Reasoning
  27 Jul 2019 3 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  An HNN consists of two component models, a masked language model and a semantic similarity model, which share a BERT-based contextual encoder but use different model-specific input and output layers.
• Deep Metric Learning by Online Soft Mining and Class-Aware Attention
  4 Nov 2018 3 repositories listed
  Therefore, we propose a novel sample mining method, called Online Soft Mining (OSM), which assigns one continuous score to each sample to make use of all samples in the mini-batch.
• Portuguese Word Embeddings: Evaluating on Word Analogies and Natural Language Tasks
  20 Aug 2017 3 repositories listed
  Word embeddings have been found to provide meaningful representations for words in an efficient way; therefore, they have become common in Natural Language Processing sys- tems.
• Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding
  17 Feb 2016 3 repositories listed
  Current systems of fine-grained entity typing use distant supervision in conjunction with existing knowledge bases to assign categories (type labels) to entity mentions.
• Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis
  20 Sep 2024 2 repositories listed
  In the second stage, LoFI leverages a pre-trained language model with a novel prompt-based tuning method to extract fine-grained information of interest from the collected logs.
• Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
  19 Sep 2024 2 repositories listed
  Our large-scale experiments, spanning 100+ LLMs and 150k minimal pairs in three languages, reveal properties of linguistic similarity from four key aspects: consistency across LLMs, relation to theoretical…
• Weakly-supervised Audio Separation via Bi-modal Semantic Similarity
  2 Apr 2024 2 repositories listed Syntology ran 11 of 18 samples · 7 unverified
  Conditional sound separation in multi-source audio mixtures without having access to single source sound data during training is a long standing challenge.
• SemRel2024: A Collection of Semantic Textual Relatedness Datasets for 13 Languages
  13 Feb 2024 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Exploring and quantifying semantic relatedness is central to representing language and holds significant implications across various NLP tasks.
• Def2Vec: Extensible Word Embeddings from Dictionary Definitions
  16 Dec 2023 2 repositories listed
  Def2Vec introduces a novel paradigm for word embeddings, leveraging dictionary definitions to learn semantic representations.
• BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings
  9 Nov 2023 2 repositories listed Syntology ran 7 of 7 samples · 0 unverified
  Most recent studies employed large language models (LLMs) to learn sentence embeddings.
• Visual Grounding Helps Learn Word Meanings in Low-Data Regimes
  20 Oct 2023 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  But to achieve these results, LMs must be trained in distinctly un-human-like ways - requiring orders of magnitude more language data than children receive during development, and without perceptual or social context.
• Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
  24 Aug 2023 2 repositories listed
  In this work, we use a multilingual knowledge distillation approach to train BERT models to produce sentence embeddings for Ancient Greek text.
• Class-relation Knowledge Distillation for Novel Class Discovery
  18 Jul 2023 2 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 1 pointer-only (licence)
  In addition, to enable a flexible knowledge distillation scheme for each data point in novel classes, we develop a learnable weighting function for the regularization, which adaptively promotes knowledge transfer based…
• Real-World Image Variation by Aligning Diffusion Inversion Chain
  30 May 2023 2 repositories listed Syntology ran 2 of 5 samples · 3 unverified
  Our pipeline enhances the generation quality of image variations by aligning the image generation process to the source image's inversion chain.
• AlignScore: Evaluating Factual Consistency with a Unified Alignment Function
  26 May 2023 2 repositories listed
  AlignScore is based on a general function of information alignment between two arbitrary text pieces.
• FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models
  23 May 2023 2 repositories listed
  However, if we want to use a new tokenizer specialized for the target language, we cannot transfer the source model's embedding matrix.
• Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs
  19 May 2023 2 repositories listed
  Large Language Models (LLMs), such as \texttt{ChatGPT}, greatly empower dialogue systems with strong language understanding and generation capabilities.

Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.