Methods › Natural Language Processing › Static Word Embeddings › CBoW Word2Vec
Continuous Bag-of-Words Word2Vec
CBoW Word2Vec
Introduced by Tomas Mikolov et al. in Efficient Estimation of Word Representations in Vector Space
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Continuous Bag-of-Words Word2Vec is an architecture for creating word embeddings that uses n future words as well as n past words to create a word embedding. The objective function for CBOW is:
J_θ = 1/T∑ᵀₜ₌₁logp(wₜ|wₜ₋ₙ,…,wₜ₋₁, wₜ₊₁,…,wₜ₊ₙ)
In the CBOW model, the distributed representations of context are used to predict the word in the middle of the window. This contrasts with Skip-gram Word2Vec where the distributed representation of the input word is used to predict the context.
Papers archive 2025-07-28
6 shown of 6, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
HuSpaCy: an industrial-strength Hungarian natural language processing toolkit 6 Jan 2022 · 1 repository · arXiv:2201.01956Syntology ran 0 of 2 samples · 2 unverified
-
A Statutory Article Retrieval Dataset in French 26 Aug 2021 · 1 repository · arXiv:2108.11792
-
LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguation 16 Apr 2021 · 0 repositories · arXiv:2104.08110
-
FarsTail: A Persian Natural Language Inference Dataset 18 Sep 2020 · 1 repository · arXiv:2009.08820
-
IP2Vec: Learning Similarities Between IP Addresses 21 Nov 2017 · 1 repository
-
Efficient Estimation of Word Representations in Vector Space 16 Jan 2013 · 84 repositories · arXiv:1301.3781Syntology ran 19 of 62 samples · 43 unverified · 18 pointer-only (licence)
Tasks archive 2025-07-28
17 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| 2k | 1 |
| Articles | 1 |
| Dependency Parsing | 1 |
| Information Retrieval | 1 |
| LEMMA | 1 |
| Lemmatization | 1 |
| Multiple-choice | 1 |
| NER | 1 |
| Natural Language Inference | 1 |
| POS | 1 |
| Retrieval | 1 |
| SENTER | 1 |
| Sentence | 1 |
| Specificity | 1 |
| Task 2 | 1 |
| Word Embeddings | 1 |
| Word Similarity | 1 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections