Browse State-of-the-Art › Word Embeddings
Word Embeddings
1,177 papers with code · 0 benchmarks · 52 datasets archive 2025-07-28
Word embedding is the collective name for a set of language modeling and feature learning techniques in natural language processing (NLP) where words or phrases from the vocabulary are mapped to vectors of real numbers.
Techniques for learning word embeddings can include Word2Vec, GloVe, and other neural network-based approaches that train on an NLP task such as language modeling or document classification.
( Image credit: Dynamic Word Embedding for Evolving Semantic Discovery )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
52 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 52 until expanded.
Subtasks archive 2025-07-28
4 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 4,002 · with a code link: 1,177 · where Syntology ran a sample: 155 (120 with a run with no instrument failure, 35 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (155 of 4,002 tagged: 120 with a run with no instrument failure, 35 where every run was a failure of Syntology's instrument)
Page 1 of 41: papers 1 to 100 of 4,002, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
15 Jul 2016 54 repositories listed Syntology community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 31 harvested samples) · 4 pointer-only (licence)A vector representation is associated to each character n-gram; words being represented as the sum of these representations.
-
12 Dec 2016 44 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples) · 13 pointer-only (licence)We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory.
-
29 Mar 2018 24 repositories listed Syntology 18 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 22 harvested samples) · 1 pointer-only (licence)For both variants, we investigate and report the relationship between model complexity, resource consumption, the availability of transfer task training data, and task performance.
-
5 May 2017 23 repositories listed Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)Many modern NLP systems rely on word embeddings, previously trained in an unsupervised manner on large corpora, as base features.
-
11 Oct 2017 20 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)We finally describe experiments on the English-Esperanto low-resource language pair, on which there only exists a limited amount of parallel data, to show the potential impact of our method in fully unsupervised machine…
-
16 Jun 2018 14 repositories listedDespite the fast developmental pace of new sentence embedding methods, it is still challenging to find comprehensive evaluations of these different techniques.
-
26 Nov 2015 14 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 4 pointer-only (licence)Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance.
-
8 Jul 2019 12 repositories listed Syntology official (archive's flag): 3 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 2 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)To this end, we develop the Embedded Topic Model (ETM), a generative model of documents that marries traditional topic models with word embeddings.
-
27 Aug 2021 10 repositories listed Syntology official (archive's flag): 4 ran · 16 ran (of which 6 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 16 harvested samples) · 5 pointer-only (licence)Since the introduction of the transformer model by Vaswani et al. (2017), a fundamental question has yet to be answered: how does a model achieve extrapolation at inference time for sequences that are longer than it saw…
-
10 Nov 2017 9 repositories listed Syntology official (archive's flag): 2 ran · 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified (of 23 harvested samples) · 1 pointer-only (licence)We formulate language modeling as a matrix factorization problem, and show that the expressiveness of Softmax-based models (including the majority of neural language models) is limited by a Softmax bottleneck.
-
21 Jul 2016 8 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples)Geometrically, gender bias is first shown to be captured by a direction in the word embedding.
-
27 Sep 2016 7 repositories listedMany current natural language processing applications for social media rely on representation learning and utilize pre-trained word embeddings.
-
17 Jul 2015 7 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models.
-
21 Jul 2017 6 repositories listedSelecting optimal parameters for a neural network architecture can often make the difference between mediocre and state-of-the-art performance.
-
20 Apr 2017 6 repositories listedIn this paper we describe our attempt at producing a state-of-the-art Twitter sentiment classifier using Convolutional Neural Networks (CNNs) and Long Short Term Memory (LSTMs) networks.
-
12 Dec 2016 6 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)It is designed to represent the general knowledge involved in understanding language, improving natural language applications by allowing the application to better understand the meanings behind the words people use.
-
30 May 2016 6 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)Understanding how words change their meanings over time is key to models of language and cultural evolution, but historical data on meaning is scarce, making theories hard to develop and test.
-
14 Oct 2019 5 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)We evaluate three simple, normalization-centric changes to improve Transformer training.
-
26 Feb 2019 5 repositories listedTabular data is the most commonly used form of data in industry.
-
7 Mar 2017 5 repositories listedThe recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i. e. semantic representations) of word…
-
6 May 2016 5 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Distributed dense word vectors have been shown to be effective at capturing token-level semantic and syntactic regularities in language, while topic models can form interpretable representations over documents.
-
Paragraph Vectors has been recently proposed as an unsupervised method for learning distributed representations for pieces of texts.
-
15 Feb 2014 5 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)The word2vec software of Tomas Mikolov and colleagues (https://code.google.com/p/word2vec/ ) has gained a lot of traction lately, and provides state-of-the-art word embeddings.
-
28 Sep 2020 4 repositories listedThe goal of this thesis is first to study multi-relational embedding on knowledge graphs to propose a new embedding model that explains and improves previous methods, then to study the applications of multi-relational…
-
26 Mar 2020 4 repositories listedWe explore novel approaches to the task of image generation from their respective captions, building on state-of-the-art GAN architectures.
-
13 Sep 2019 4 repositories listed Syntology 18 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 1 violated, 17 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 19 harvested samples) · 1 pointer-only (licence)Moreover, we successfully transfer debiasing models, by means of cross-lingual embedding spaces, and remove or attenuate biases in distributional word vector spaces of languages that lack readily available bias…
-
29 May 2019 4 repositories listedTo address this challenge, we develop causally sufficient embeddings, low-dimensional document representations that preserve sufficient information for causal identification and allow for efficient estimation of causal…
-
13 Nov 2018 4 repositories listedDeep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017).
-
22 Oct 2018 4 repositories listedSentence embeddings have become an essential part of today's natural language processing (NLP) systems, especially together advanced deep learning methods.
-
14 May 2018 4 repositories listedWe introduce a novel graph-based framework for abstractive meeting speech summarization that is fully unsupervised and does not rely on any annotations.
-
4 Apr 2018 4 repositories listed
-
3 Oct 2017 4 repositories listed Syntology official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
7 Feb 2017 4 repositories listed
-
19 Jul 2016 4 repositories listed
-
25 May 2016 4 repositories listed
-
12 Feb 2015 4 repositories listed
-
20 Jan 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
30 Dec 2020 3 repositories listed
-
14 Sep 2020 3 repositories listed Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
28 Jun 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
18 Apr 2020 3 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
15 Jul 2019 3 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
23 May 2019 3 repositories listed
-
22 Mar 2019 3 repositories listed
-
11 Dec 2018 3 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
20 Oct 2018 3 repositories listed
-
16 Oct 2018 3 repositories listed
-
27 Aug 2018 3 repositories listed
-
29 May 2018 3 repositories listed
-
21 Apr 2018 3 repositories listed
-
18 Apr 2018 3 repositories listed
-
18 Apr 2018 3 repositories listed
-
18 Apr 2018 3 repositories listed
-
23 Mar 2018 3 repositories listed
-
9 Mar 2018 3 repositories listed
-
9 Feb 2018 3 repositories listed
-
9 Nov 2017 3 repositories listed
-
3 Nov 2017 3 repositories listed
-
13 Sep 2017 3 repositories listed
-
12 Sep 2017 3 repositories listed
-
20 Aug 2017 3 repositories listed
-
7 Aug 2017 3 repositories listed
-
6 Jul 2017 3 repositories listed
-
1 Jul 2017 3 repositories listed
-
8 Nov 2016 3 repositories listed
-
1 Jun 2015 3 repositories listed
-
16 Nov 2024 2 repositories listed
-
30 Sep 2024 2 repositories listed
-
28 May 2024 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
10 Feb 2024 2 repositories listed
-
16 Dec 2023 2 repositories listed
-
4 Apr 2023 2 repositories listed
-
6 Feb 2023 2 repositories listed
-
18 Oct 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
1 Jul 2022 2 repositories listed
-
4 Apr 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
3 Apr 2022 2 repositories listed
-
3 Mar 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 4 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
20 Feb 2022 2 repositories listed
-
16 Sep 2021 2 repositories listed
-
6 Aug 2021 2 repositories listed
-
24 Jun 2021 2 repositories listed
-
1 Apr 2021 2 repositories listed
-
19 Mar 2021 2 repositories listed
-
11 Mar 2021 2 repositories listed
-
23 Jan 2021 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Eating Garlic Prevents COVID-19 Infection: Detecting Misinformation on the Arabic Content of Twitter9 Jan 2021 2 repositories listed
-
1 Dec 2020 2 repositories listed
-
23 Oct 2020 2 repositories listed
-
19 Sep 2020 2 repositories listed
-
18 Sep 2020 2 repositories listed
-
16 Aug 2020 2 repositories listed
-
6 Jul 2020 2 repositories listed
-
24 Jun 2020 2 repositories listed
-
10 Jun 2020 2 repositories listed
-
6 Jun 2020 2 repositories listed Syntology official (archive's flag): 6 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 5 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 6 pointer-only (licence)
-
ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries6 Jun 2020 2 repositories listed
-
5 Jun 2020 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
Syntology lines on 34 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections