STS

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 129 papers with code (334 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
  27 Aug 2019 64 repositories listed Syntology ran 20 of 58 samples · 38 unverified · 11 pointer-only (licence)
  However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10, 000 sentences requires about 50 million inference…
• SimCSE: Simple Contrastive Learning of Sentence Embeddings
  18 Apr 2021 23 repositories listed Syntology ran 17 of 30 samples · 13 unverified · 19 pointer-only (licence)
  This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings.
• TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning
  14 Apr 2021 6 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Learning sentence embeddings often requires a large amount of labeled data.
• MTEB: Massive Text Embedding Benchmark
  13 Oct 2022 5 repositories listed Syntology ran 3 of 13 samples · 10 unverified
  MTEB spans 8 embedding tasks covering a total of 58 datasets and 112 languages.
• MedSTS: A Resource for Clinical Semantic Textual Similarity
  28 Aug 2018 5 repositories listed
  A subset of MedSTS (MedSTS_ann) containing 1, 068 sentence pairs was annotated by two medical experts with semantic similarity scores of 0-5 (low to high similarity).
• KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  7 Apr 2020 3 repositories listed
  Although several benchmark datasets for those tasks have been released in English and a few other languages, there are no publicly available NLI or STS datasets in the Korean language.
• SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation
  31 Jul 2017 3 repositories listed
  Semantic Textual Similarity (STS) measures the meaning similarity of sentences.
• Pcc-tuning: Breaking the Contrastive Learning Ceiling in Semantic Textual Similarity
  14 Jun 2024 2 repositories listed
  Semantic Textual Similarity (STS) constitutes a critical research direction in computational linguistics and serves as a key indicator of the encoding capabilities of embedding models.
• Advancing Semantic Textual Similarity Modeling: A Regression Framework with Translated ReLU and Smooth K2 Loss
  8 Jun 2024 2 repositories listed
  Since the introduction of BERT and RoBERTa, research on Semantic Textual Similarity (STS) has made groundbreaking progress.
• Pixel Sentence Representation Learning
  13 Feb 2024 2 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  To our knowledge, this is the first representation learning method devoid of traditional language models for understanding sentence and document semantics, marking a stride closer to human-like textual comprehension.
• BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings
  9 Nov 2023 2 repositories listed Syntology ran 7 of 7 samples · 0 unverified
  Most recent studies employed large language models (LLMs) to learn sentence embeddings.
• AnglE-optimized Text Embeddings
  22 Sep 2023 2 repositories listed
  This novel approach effectively mitigates the adverse effects of the saturation zone in the cosine function, which can impede gradient and hinder optimization processes.
• InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings
  8 Oct 2022 2 repositories listed
  Contrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer.
• ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding
  9 Sep 2021 2 repositories listed
  Unsup-SimCSE takes dropout as a minimal data augmentation method, and passes the same input sentence to a pre-trained Transformer encoder (with dropout turned on) twice to obtain the two corresponding embeddings to…
• Smoothed Contrastive Learning for Unsupervised Sentence Embedding
  9 Sep 2021 2 repositories listed
  Contrastive learning has been gradually applied to learn high-quality unsupervised sentence embedding.
• Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models
  19 Aug 2021 2 repositories listed
  To support our investigation, we establish a new sentence representation transfer benchmark, SentGLUE, which extends the SentEval toolkit to nine tasks from the GLUE benchmark.
• PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT
  22 Mar 2021 2 repositories listed
  This study provides an efficient approach for using text data to calculate patent-to-patent (p2p) technological similarity, and presents a hybrid framework for leveraging the resulting p2p similarity for applications…
• FFCI: A Framework for Interpretable Automatic Evaluation of Summarization
  27 Nov 2020 2 repositories listed
  In this paper, we propose FFCI, a framework for fine-grained summarization evaluation that comprises four elements: faithfulness (degree of factual consistency with the source), focus (precision of summary content…
• Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors
  30 Apr 2019 2 repositories listed
  Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.
• Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
  19 May 2025 1 repository listed
  Previous studies usually focus on prompt engineering to guide LLMs to encode the core semantic information of the sentence into the embedding of the last token.
• Parameter-Efficient Transformer Embeddings
  4 May 2025 1 repository listed
  Embedding layers in transformer-based NLP models typically account for the largest share of model parameters, scaling with vocabulary size but not yielding performance gains proportional to scale.
• Domain Adaptation for Japanese Sentence Embeddings with Contrastive Learning based on Synthetic Sentence Generation
  12 Mar 2025 1 repository listed
  Such sentence embeddings can be further enhanced by domain adaptation that adapts a backbone model to a specific domain.
• TextInPlace: Indoor Visual Place Recognition in Repetitive Structures with Scene Text Spotting and Verification
  9 Mar 2025 1 repository listed
  Visual Place Recognition (VPR) is a crucial capability for long-term autonomous robots, enabling them to identify previously visited locations using visual information.
• FinMTEB: Finance Massive Text Embedding Benchmark
  16 Feb 2025 1 repository listed
  Embedding models play a crucial role in representing and retrieving information across various NLP applications.
• Fast, Precise Thompson Sampling for Bayesian Optimization
  26 Nov 2024 1 repository listed Syntology ran 1 of 2 samples · 1 unverified
  Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems.
• 2D Matryoshka Training for Information Retrieval
  26 Nov 2024 1 repository listed
  In this reproducibility study, we implement and evaluate both versions of 2D Matryoshka Training on STS tasks and extend our analysis to retrieval tasks.
• GenEOL: Harnessing the Generative Power of LLMs for Training-Free Sentence Embeddings
  18 Oct 2024 1 repository listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  Training-free embedding methods directly leverage pretrained large language models (LLMs) to embed text, bypassing the costly and complex procedure of contrastive learning.
• Distilling Monolingual and Crosslingual Word-in-Context Representations
  13 Sep 2024 1 repository listed
  The results on the monolingual tasks confirmed that our representations exhibited a competitive performance compared to that of the previous study for the context-aware lexical semantic tasks and outperformed it for STS…
• ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings
  28 Aug 2024 1 repository listed
  This paper examines the Code-Switching (CS) phenomenon where two languages intertwine within a single utterance.
• Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuning
  1 Aug 2024 1 repository listed
  While Large Language Models show remarkable performance in natural language understanding, their resource-intensive nature makes them less accessible.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.