{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/streaming-word-embeddings-with-the-space","title":"Streaming Word Embeddings with the Space-Saving Algorithm","arxiv_id":"1704.07463","date":"2017-04-24","proceeding":null,"authors":["Chandler May","Kevin Duh","Benjamin Van Durme","Ashwin Lall"],"abstract":"We develop a streaming (one-pass, bounded-memory) word embedding algorithm\nbased on the canonical skip-gram with negative sampling algorithm implemented\nin word2vec. We compare our streaming algorithm to word2vec empirically by\nmeasuring the cosine similarity between word pairs under each algorithm and by\napplying each algorithm in the downstream task of hashtag prediction on a\ntwo-month interval of the Twitter sample stream. We then discuss the results of\nthese experiments, concluding they provide partial validation of our approach\nas a streaming replacement for word2vec. Finally, we discuss potential failure\nmodes and suggest directions for future work.","url_abs":"http://arxiv.org/abs/1704.07463v1","url_pdf":"http://arxiv.org/pdf/1704.07463v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"streaming-word-embeddings-with-the-space","repo_url":"https://github.com/cjmay/athena","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"streaming-word-embeddings-with-the-space","repo_url":"https://github.com/cjmay/word2vec","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}