{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/using-multi-sense-vector-embeddings-for","title":"Using Multi-Sense Vector Embeddings for Reverse Dictionaries","arxiv_id":"1904.01451","date":"2019-04-02","proceeding":"WS 2019 5","authors":["Michael A. Hedderich","Andrew Yates","Dietrich Klakow","Gerard de Melo"],"abstract":"Popular word embedding methods such as word2vec and GloVe assign a single\nvector representation to each word, even if a word has multiple distinct\nmeanings. Multi-sense embeddings instead provide different vectors for each\nsense of a word. However, they typically cannot serve as a drop-in replacement\nfor conventional single-sense embeddings, because the correct sense vector\nneeds to be selected for each word. In this work, we study the effect of\nmulti-sense embeddings on the task of reverse dictionaries. We propose a\ntechnique to easily integrate them into an existing neural network architecture\nusing an attention mechanism. Our experiments demonstrate that large\nimprovements can be obtained when employing multi-sense embeddings both in the\ninput sequence as well as for the target representation. An analysis of the\nsense distributions and of the learned attention is provided as well.","url_abs":"http://arxiv.org/abs/1904.01451v1","url_pdf":"http://arxiv.org/pdf/1904.01451v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"using-multi-sense-vector-embeddings-for","repo_url":"https://github.com/uds-lsv/Multi-Sense-Embeddings-Reverse-Dictionaries","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[],"methods":[{"method_slug":"glove","method_name":"GloVe"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1904.01451","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}