Sentence Embedding

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

8 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 162 papers with code (407 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
  27 Aug 2019 64 repositories listed Syntology ran 20 of 58 samples · 38 unverified · 11 pointer-only (licence)
  However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10, 000 sentences requires about 50 million inference…
• A Structured Self-attentive Sentence Embedding
  9 Mar 2017 52 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 2 pointer-only (licence)
  This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention.
• Evaluation of sentence embeddings in downstream and linguistic probing tasks
  16 Jun 2018 14 repositories listed
  Despite the fast developmental pace of new sentence embedding methods, it is still challenging to find comprehensive evaluations of these different techniques.
• Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation
  21 Apr 2020 12 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  The training is based on the idea that a translated sentence should be mapped to the same location in the vector space as the original sentence.
• TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning
  14 Apr 2021 6 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Learning sentence embeddings often requires a large amount of labeled data.
• Language-agnostic BERT Sentence Embedding
  3 Jul 2020 6 repositories listed
  While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings…
• ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor
  27 Apr 2020 4 repositories listed
  The proposed technical method initiates by separating sentences of the given text and utilizing the BERT model to generate embeddings for each one.
• On the Sentence Embeddings from Pre-trained Language Models
  2 Nov 2020 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Pre-trained contextual representations like BERT have achieved great success in natural language processing.
• SBERT-WK: A Sentence Embedding Method by Dissecting BERT-based Word Models
  16 Feb 2020 3 repositories listed
  Yet, it is an open problem to generate a high quality sentence representation from BERT-based word models.
• DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
  14 Sep 2017 3 repositories listed
  Recurrent neural nets (RNN) and convolutional neural nets (CNN) are widely used on NLP tasks to capture the long-term and local dependencies, respectively.
• Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks
  15 Aug 2016 3 repositories listed
  The analysis sheds light on the relative strengths of different sentence embedding methods with respect to these low level prediction tasks, and on the effect of the encoded vector's dimensionality on the resulting…
• Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books
  22 Jun 2015 3 repositories listed
  Books are a rich source of both fine-grained information, how a character, an object or a scene looks like, as well as high-level semantics, what someone is thinking, feeling and how these states evolve through a story.
• Simple Techniques for Enhancing Sentence Embeddings in Generative Language Models
  5 Apr 2024 2 repositories listed
  Sentence Embedding stands as a fundamental task within the realm of Natural Language Processing, finding extensive application in search engines, expert systems, and question-and-answer platforms.
• Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
  24 Aug 2023 2 repositories listed
  In this work, we use a multilingual knowledge distillation approach to train BERT models to produce sentence embeddings for Ancient Greek text.
• miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings
  9 Nov 2022 2 repositories listed
  This study opens up avenues for efficient self-supervised learning methods that are more robust than current contrastive methods for sentence embedding.
• Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding
  14 Oct 2022 2 repositories listed
  Dataset bias has attracted increasing attention recently for its detrimental effect on the generalization ability of fine-tuned models.
• InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings
  8 Oct 2022 2 repositories listed
  Contrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer.
• ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding
  9 Sep 2021 2 repositories listed
  Unsup-SimCSE takes dropout as a minimal data augmentation method, and passes the same input sentence to a pre-trained Transformer encoder (with dropout turned on) twice to obtain the two corresponding embeddings to…
• Smoothed Contrastive Learning for Unsupervised Sentence Embedding
  9 Sep 2021 2 repositories listed
  Contrastive learning has been gradually applied to learn high-quality unsupervised sentence embedding.
• A Bilingual Generative Transformer for Semantic Sentence Embedding
  10 Nov 2019 2 repositories listed
  Semantic sentence embedding models encode natural language sentences into vectors, such that closeness in embedding space indicates closeness in the semantics between the sentences.
• Discovering the Compositional Structure of Vector Representations with Role Learning Networks
  21 Oct 2019 2 repositories listed
  How can neural networks perform so well on compositional tasks even though they lack explicit compositional representations?
• Sentence Embedding Alignment for Lifelong Relation Extraction
  6 Mar 2019 2 repositories listed
  We formulate such a challenging problem as lifelong relation extraction and investigate memory-efficient incremental learning methods without catastrophically forgetting knowledge learned from previous tasks.
• Learning to Embed Sentences Using Attentive Recursive Trees
  6 Nov 2018 2 repositories listed
  Sentence embedding is an effective feature representation for most deep learning-based NLP tasks.
• Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations
  29 Aug 2018 2 repositories listed
  We present a framework for building unsupervised representations of entities and their compositions, where each entity is viewed as a probability distribution rather than a vector embedding.
• Neural Sentence Embedding using Only In-domain Sentences for Out-of-domain Sentence Detection in Dialog Systems
  27 Jul 2018 2 repositories listed
  Then we used domain-category analysis as an auxiliary task to train neural sentence embedding for OOD sentence detection.
• Learning Semantic Sentence Embeddings using Sequential Pair-wise Discriminator
  3 Jun 2018 2 repositories listed Syntology ran 4 of 17 samples · 13 unverified
  One way to ensure this is by adding constraints for true paraphrase embeddings to be close and unrelated paraphrase candidate sentence embeddings to be far.
• Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
  19 May 2025 1 repository listed
  Previous studies usually focus on prompt engineering to guide LLMs to encode the core semantic information of the sentence into the embedding of the last token.
• Information Leakage of Sentence Embeddings via Generative Embedding Inversion Attacks
  23 Apr 2025 1 repository listed
  The key idea is to examine differences between log-likelihood for masked and original variants of data that sentence embedding models have been pre-trained on, calculated on the embedding space of the attacker.
• IPCGRL: Language-Instructed Reinforcement Learning for Procedural Level Generation
  16 Mar 2025 1 repository listed
  In this paper, we propose IPCGRL, an instruction-based procedural content generation method via reinforcement learning, which incorporates a sentence embedding model.
• FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis
  23 Feb 2025 1 repository listed
  Parody is an emerging phenomenon on social media, where individuals imitate a role or position opposite to their own, often for humor, provocation, or controversy.

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.