{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/extrofitting-enriching-word-representation","title":"Extrofitting: Enriching Word Representation and its Vector Space with Semantic Lexicons","arxiv_id":"1804.07946","date":"2018-04-21","proceeding":"WS 2018 7","authors":["Hwiyeol Jo","Stanley Jungkyu Choi"],"abstract":"We propose post-processing method for enriching not only word representation\nbut also its vector space using semantic lexicons, which we call extrofitting.\nThe method consists of 3 steps as follows: (i) Expanding 1 or more dimension(s)\non all the word vectors, filling with their representative value. (ii)\nTransferring semantic knowledge by averaging each representative values of\nsynonyms and filling them in the expanded dimension(s). These two steps make\nrepresentations of the synonyms close together. (iii) Projecting the vector\nspace using Linear Discriminant Analysis, which eliminates the expanded\ndimension(s) with semantic knowledge. When experimenting with GloVe, we find\nthat our method outperforms Faruqui's retrofitting on some of word similarity\ntask. We also report further analysis on our method in respect to word vector\ndimensions, vocabulary size as well as other well-known pretrained word vectors\n(e.g., Word2Vec, Fasttext).","url_abs":"http://arxiv.org/abs/1804.07946v2","url_pdf":"http://arxiv.org/pdf/1804.07946v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"extrofitting-enriching-word-representation","repo_url":"https://github.com/HwiyeolJo/Extrofitting","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"extrofitting-enriching-word-representation","repo_url":"https://github.com/imayachita/Unsupervised-Extrofitting","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"word-similarity","task_name":"Word Similarity"}],"methods":[{"method_slug":"glove","method_name":"GloVe"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1804.07946","atlas_url":"https://app.syntology.ai/?focus=1804.07946","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}