Word Embeddings

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

52 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 52 until expanded.

Subtasks archive 2025-07-28

4 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 1,177 papers with code (4,002 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Enriching Word Vectors with Subword Information
  15 Jul 2016 54 repositories listed Syntology ran 4 of 31 samples · 27 unverified · 4 pointer-only (licence)
  A vector representation is associated to each character n-gram; words being represented as the sum of these representations.
• FastText.zip: Compressing text classification models
  12 Dec 2016 44 repositories listed Syntology ran 3 of 18 samples · 15 unverified · 12 pointer-only (licence)
  We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory.
• Universal Sentence Encoder
  29 Mar 2018 24 repositories listed Syntology ran 1 of 22 samples · 21 unverified · 1 pointer-only (licence)
  For both variants, we investigate and report the relationship between model complexity, resource consumption, the availability of transfer task training data, and task performance.
• Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
  5 May 2017 23 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Many modern NLP systems rely on word embeddings, previously trained in an unsupervised manner on large corpora, as base features.
• Word Translation Without Parallel Data
  11 Oct 2017 20 repositories listed Syntology ran 6 of 8 samples · 2 unverified · 8 pointer-only (licence)
  We finally describe experiments on the English-Esperanto low-resource language pair, on which there only exists a limited amount of parallel data, to show the potential impact of our method in fully unsupervised machine…
• Evaluation of sentence embeddings in downstream and linguistic probing tasks
  16 Jun 2018 14 repositories listed
  Despite the fast developmental pace of new sentence embedding methods, it is still challenging to find comprehensive evaluations of these different techniques.
• Named Entity Recognition with Bidirectional LSTM-CNNs
  26 Nov 2015 14 repositories listed Syntology ran 4 of 9 samples · 5 unverified · 4 pointer-only (licence)
  Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance.
• Topic Modeling in Embedding Spaces
  8 Jul 2019 12 repositories listed Syntology ran 3 of 13 samples · 10 unverified
  To this end, we develop the Embedded Topic Model (ETM), a generative model of documents that marries traditional topic models with word embeddings.
• Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
  27 Aug 2021 10 repositories listed Syntology ran 13 of 16 samples · 3 unverified · 5 pointer-only (licence)
  Since the introduction of the transformer model by Vaswani et al.
• Breaking the Softmax Bottleneck: A High-Rank RNN Language Model
  10 Nov 2017 9 repositories listed Syntology ran 1 of 23 samples · 22 unverified
  We formulate language modeling as a matrix factorization problem, and show that the expressiveness of Softmax-based models (including the majority of neural language models) is limited by a Softmax bottleneck.
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
  21 Jul 2016 8 repositories listed Syntology ran 0 of 8 samples · 8 unverified
  Geometrically, gender bias is first shown to be captured by a direction in the word embedding.
• emoji2vec: Learning Emoji Representations from their Description
  27 Sep 2016 7 repositories listed
  Many current natural language processing applications for social media rely on representation learning and utilize pre-trained word embeddings.
• Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
  17 Jul 2015 7 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models.
• Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
  21 Jul 2017 6 repositories listed
  Selecting optimal parameters for a neural network architecture can often make the difference between mediocre and state-of-the-art performance.
• BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs
  20 Apr 2017 6 repositories listed
  In this paper we describe our attempt at producing a state-of-the-art Twitter sentiment classifier using Convolutional Neural Networks (CNNs) and Long Short Term Memory (LSTMs) networks.
• ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
  12 Dec 2016 6 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  It is designed to represent the general knowledge involved in understanding language, improving natural language applications by allowing the application to better understand the meanings behind the words people use.
• Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change
  30 May 2016 6 repositories listed Syntology ran 0 of 8 samples · 8 unverified
  Understanding how words change their meanings over time is key to models of language and cultural evolution, but historical data on meaning is scarce, making theories hard to develop and test.
• Transformers without Tears: Improving the Normalization of Self-Attention
  14 Oct 2019 5 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  We evaluate three simple, normalization-centric changes to improve Transformer training.
• SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data
  26 Feb 2019 5 repositories listed
  Tabular data is the most commonly used form of data in industry.
• Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
  7 Mar 2017 5 repositories listed
  The recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.
• Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec
  6 May 2016 5 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Distributed dense word vectors have been shown to be effective at capturing token-level semantic and syntactic regularities in language, while topic models can form interpretable representations over documents.
• Document Embedding with Paragraph Vectors
  29 Jul 2015 5 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  Paragraph Vectors has been recently proposed as an unsupervised method for learning distributed representations for pieces of texts.
• word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method
  15 Feb 2014 5 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  The word2vec software of Tomas Mikolov and colleagues (https://code.
• Multi-Relational Embedding for Knowledge Graph Representation and Analysis
  28 Sep 2020 4 repositories listed
  The goal of this thesis is first to study multi-relational embedding on knowledge graphs to propose a new embedding model that explains and improves previous methods, then to study the applications of multi-relational…
• Cycle Text-To-Image GAN with BERT
  26 Mar 2020 4 repositories listed
  We explore novel approaches to the task of image generation from their respective captions, building on state-of-the-art GAN architectures.
• A General Framework for Implicit and Explicit Debiasing of Distributional Word Vector Spaces
  13 Sep 2019 4 repositories listed Syntology ran 1 of 19 samples · 18 unverified · 1 pointer-only (licence)
  Moreover, we successfully transfer debiasing models, by means of cross-lingual embedding spaces, and remove or attenuate biases in distributional word vector spaces of languages that lack readily available bias…
• Adapting Text Embeddings for Causal Inference
  29 May 2019 4 repositories listed
  To address this challenge, we develop causally sufficient embeddings, low-dimensional document representations that preserve sufficient information for causal identification and allow for efficient estimation of causal…
• Few-shot Learning for Named Entity Recognition in Medical Text
  13 Nov 2018 4 repositories listed
  Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017).
• BioSentVec: creating sentence embeddings for biomedical texts
  22 Oct 2018 4 repositories listed
  Sentence embeddings have become an essential part of today's natural language processing (NLP) systems, especially together advanced deep learning methods.
• Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization
  14 May 2018 4 repositories listed
  We introduce a novel graph-based framework for abstractive meeting speech summarization that is fully unsupervised and does not rely on any annotations.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.