{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dynamic-word-embeddings","title":"Dynamic Word Embeddings","arxiv_id":"1702.08359","date":"2017-02-27","proceeding":"ICML 2017 8","authors":["Robert Bamler","Stephan Mandt"],"abstract":"We present a probabilistic language model for time-stamped text data which\ntracks the semantic evolution of individual words over time. The model\nrepresents words and contexts by latent trajectories in an embedding space. At\neach moment in time, the embedding vectors are inferred from a probabilistic\nversion of word2vec [Mikolov et al., 2013]. These embedding vectors are\nconnected in time through a latent diffusion process. We describe two scalable\nvariational inference algorithms--skip-gram smoothing and skip-gram\nfiltering--that allow us to train the model jointly over all times; thus\nlearning on all data while simultaneously allowing word and context vectors to\ndrift. Experimental results on three different corpora demonstrate that our\ndynamic model infers word embedding trajectories that are more interpretable\nand lead to higher predictive likelihoods than competing methods that are based\non static models trained separately on time slices.","url_abs":"http://arxiv.org/abs/1702.08359v2","url_pdf":"http://arxiv.org/pdf/1702.08359v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dynamic-word-embeddings","repo_url":"https://github.com/accessai/dynamic_word_embeddings","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"variational-inference","task_name":"Variational Inference"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1702.08359","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1702.08359"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/accessai/dynamic_word_embeddings","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":1},"by_repo_kind":{"listed":{"samples":1,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1dc3bd4b6a8fd994","entry":"load_pickle","repo":"accessai/dynamic_word_embeddings","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/accessai/dynamic_word_embeddings/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1dc3bd4b6a8fd994"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}