{"url":"/method/glove","slug":"glove","name":"GloVe","full_name":"GloVe Embeddings","full_name_withheld":false,"description_markdown":"**GloVe Embeddings** are a type of word embedding that encode the co-occurrence probability ratio between two words as vector differences. GloVe uses a weighted least squares objective $J$ that minimizes the difference between the dot product of the vectors of two words and the logarithm of their number of co-occurrences:\r\n\r\n$$ J=\\sum\\_{i, j=1}^{V}f\\left(𝑋\\_{i j}\\right)(w^{T}\\_{i}\\tilde{w}_{j} + b\\_{i} + \\tilde{b}\\_{j} - \\log{𝑋}\\_{ij})^{2} $$\r\n\r\nwhere $w\\_{i}$ and $b\\_{i}$ are the word vector and bias respectively of word $i$, $\\tilde{w}_{j}$ and $b\\_{j}$ are the context word vector and bias respectively of word $j$, $X\\_{ij}$ is the number of times word $i$ occurs in the context of word $j$, and $f$ is a weighting function that assigns lower weights to rare and frequent co-occurrences.","description_state":"present","introduced_year":null,"introduced_by":{"title":"GloVe: Global Vectors for Word Representation","paper":"/paper/glove-global-vectors-for-word-representation","first_author":"Jeffrey Pennington","n_authors":3,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/glove-global-vectors-for-word-representation"},"source":{"url":"https://aclanthology.org/D14-1162","title":"GloVe: Global Vectors for Word Representation","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Static Word Embeddings","url":"/methods/category/static-word-embeddings","pwc_aliases":[]},{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Word Embeddings","url":"/methods/category/word-embeddings","pwc_aliases":[]}],"n_papers_tagged":357,"archive_num_papers":357,"papers_newest_first":[{"paper":"/paper/cove-compressed-vocabulary-expansion-makes","title":"CoVE: Compressed Vocabulary Expansion Makes Better LLM-based Recommender Systems","date":"2025-06-24","arxiv_id":"2506.19993","n_code_links":1,"syntology":{"ran":0,"of":4,"unverified":4,"pointer_only":4}},{"paper":null,"title":"Diver-Robot Communication Dataset for Underwater Hand Gesture Recognition","date":"2025-06-10","arxiv_id":"2506.08974","n_code_links":0,"syntology":null},{"paper":null,"title":"Gender Inequality in English Textbooks Around the World: an NLP Approach","date":"2025-06-03","arxiv_id":"2506.02425","n_code_links":0,"syntology":null},{"paper":null,"title":"Feel the Force: Contact-Driven Learning from Humans","date":"2025-06-02","arxiv_id":"2506.01944","n_code_links":0,"syntology":null},{"paper":null,"title":"On the Emergence of Linear Analogies in Word Embeddings","date":"2025-05-24","arxiv_id":"2505.18651","n_code_links":0,"syntology":null},{"paper":null,"title":"Omni TM-AE: A Scalable and Interpretable Embedding Model Using the Full Tsetlin Machine State Space","date":"2025-05-22","arxiv_id":"2505.16386","n_code_links":0,"syntology":null},{"paper":null,"title":"Imitation Learning for Adaptive Control of a Virtual Soft Exoglove","date":"2025-05-14","arxiv_id":"2505.09099","n_code_links":0,"syntology":null},{"paper":null,"title":"Graph Neural Network Aided Deep Reinforcement Learning for Resource Allocation in Dynamic Terahertz UAV Networks","date":"2025-05-08","arxiv_id":"2505.04981","n_code_links":0,"syntology":null},{"paper":null,"title":"A Method for Handling Negative Similarities in Explainable Graph Spectral Clustering of Text Documents -- Extended Version","date":"2025-04-16","arxiv_id":"2504.12360","n_code_links":0,"syntology":null},{"paper":"/paper/geological-inference-from-textual-data-using","title":"Geological Inference from Textual Data using Word Embeddings","date":"2025-04-10","arxiv_id":"2504.07490","n_code_links":1,"syntology":null},{"paper":null,"title":"Text classification using machine learning methods","date":"2025-02-27","arxiv_id":"2502.19801","n_code_links":0,"syntology":null},{"paper":null,"title":"Revisiting Word Embeddings in the LLM Era","date":"2025-02-26","arxiv_id":"2502.19607","n_code_links":0,"syntology":null},{"paper":"/paper/exploring-rwkv-for-sentence-embeddings-layer","title":"Exploring RWKV for Sentence Embeddings: Layer-wise Analysis and Baseline Comparison for Semantic Similarity","date":"2025-02-20","arxiv_id":"2502.14620","n_code_links":1,"syntology":null},{"paper":null,"title":"Breast Lump Detection and Localization with a Tactile Glove Using Deep Learning","date":"2025-02-15","arxiv_id":"2502.15767","n_code_links":0,"syntology":null},{"paper":"/paper/cove-context-and-veracity-prediction-for-out","title":"COVE: COntext and VEracity prediction for out-of-context images","date":"2025-02-03","arxiv_id":"2502.01194","n_code_links":2,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":0}},{"paper":"/paper/rohan-robust-hand-detection-in-operation-room","title":"RoHan: Robust Hand Detection in Operation Room","date":"2025-01-14","arxiv_id":"2501.08115","n_code_links":1,"syntology":null},{"paper":null,"title":"Text Classification: Neural Networks VS Machine Learning Models VS Pre-trained Models","date":"2024-12-30","arxiv_id":"2412.21022","n_code_links":0,"syntology":null},{"paper":"/paper/on-the-role-of-surrogates-in-conformal","title":"On the Role of Surrogates in Conformal Inference of Individual Causal Effects","date":"2024-12-16","arxiv_id":"2412.12365","n_code_links":1,"syntology":null},{"paper":null,"title":"Measuring similarity between embedding spaces using induced neighborhood graphs","date":"2024-11-13","arxiv_id":"2411.08687","n_code_links":0,"syntology":null},{"paper":null,"title":"From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models","date":"2024-11-06","arxiv_id":"2411.05036","n_code_links":0,"syntology":null},{"paper":null,"title":"NLP and Education: using semantic similarity to evaluate filled gaps in a large-scale Cloze test in the classroom","date":"2024-11-02","arxiv_id":"2411.01280","n_code_links":0,"syntology":null},{"paper":null,"title":"Generic Embedding-Based Lexicons for Transparent and Reproducible Text Scoring","date":"2024-11-01","arxiv_id":"2411.00964","n_code_links":0,"syntology":null},{"paper":"/paper/lowrem-a-repository-of-word-embeddings-for-87","title":"GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge","date":"2024-09-26","arxiv_id":"2409.18193","n_code_links":1,"syntology":null},{"paper":null,"title":"An Evaluation of Sindhi Word Embedding in Semantic Analogies and Downstream Tasks","date":"2024-08-28","arxiv_id":"2408.15720","n_code_links":0,"syntology":null},{"paper":null,"title":"AI-Powered Camera and Sensors for the Rehabilitation Hand Exoskeleton","date":"2024-08-09","arxiv_id":"2408.15248","n_code_links":0,"syntology":null},{"paper":null,"title":"The Literature Review Network: An Explainable Artificial Intelligence for Systematic Literature Reviews, Meta-analyses, and Method Development","date":"2024-08-05","arxiv_id":"2408.05239","n_code_links":0,"syntology":null},{"paper":"/paper/2408-01961","title":"Representation Bias of Adolescents in AI: A Bilingual, Bicultural Study","date":"2024-08-04","arxiv_id":"2408.01961","n_code_links":1,"syntology":null},{"paper":null,"title":"Banyan: Improved Representation Learning with Explicit Structure","date":"2024-07-25","arxiv_id":"2407.17771","n_code_links":0,"syntology":null},{"paper":"/paper/the-collection-of-a-human-robot-collaboration","title":"The Collection of a Human Robot Collaboration Dataset for Cooperative Assembly in Glovebox Environments","date":"2024-07-19","arxiv_id":"2407.14649","n_code_links":1,"syntology":null},{"paper":null,"title":"On Initializing Transformers with Pre-trained Embeddings","date":"2024-07-17","arxiv_id":"2407.12514","n_code_links":0,"syntology":null}],"papers_shown":30,"tasks":[{"task":"/task/word-embeddings","name":"Word Embeddings","papers":156},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":37},{"task":"/task/sentence","name":"Sentence","papers":32},{"task":"/task/classification","name":"General Classification","papers":29},{"task":"/task/text-classification","name":"Text Classification","papers":26},{"task":"/task/language-modelling","name":"Language Modelling","papers":22},{"task":"/task/classification-1","name":"Classification","papers":21},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":21},{"task":"/task/text-classification-1","name":"text-classification","papers":19},{"task":"/task/machine-translation","name":"Machine Translation","papers":17},{"task":"/task/language-modeling","name":"Language Modeling","papers":16},{"task":"/task/question-answering","name":"Question Answering","papers":16},{"task":"/task/retrieval","name":"Retrieval","papers":14},{"task":"/task/word-similarity","name":"Word Similarity","papers":14},{"task":"/task/information-retrieval","name":"Information Retrieval","papers":13},{"task":"/task/semantic-textual-similarity","name":"Semantic Textual Similarity","papers":13},{"task":"/task/translation","name":"Translation","papers":13},{"task":"/task/articles","name":"Articles","papers":12},{"task":"/task/named-entity-recognition-ner","name":"Named Entity Recognition (NER)","papers":12},{"task":"/task/semantic-similarity","name":"Semantic Similarity","papers":12}],"tasks_shown":20,"n_tasks":245,"usage_by_year":[{"year":"2014","papers":2},{"year":"2015","papers":2},{"year":"2016","papers":13},{"year":"2017","papers":22},{"year":"2018","papers":41},{"year":"2019","papers":55},{"year":"2020","papers":63},{"year":"2021","papers":55},{"year":"2022","papers":25},{"year":"2023","papers":33},{"year":"2024","papers":30},{"year":"2025","papers":16}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/glove"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}