{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/siamese-cbow-optimizing-word-embeddings-for","title":"Siamese CBOW: Optimizing Word Embeddings for Sentence Representations","arxiv_id":"1606.04640","date":"2016-06-15","proceeding":"ACL 2016 8","authors":["Tom Kenter","Alexey Borisov","Maarten de Rijke"],"abstract":"We present the Siamese Continuous Bag of Words (Siamese CBOW) model, a neural\nnetwork for efficient estimation of high-quality sentence embeddings. Averaging\nthe embeddings of words in a sentence has proven to be a surprisingly\nsuccessful and efficient way of obtaining sentence embeddings. However, word\nembeddings trained with the methods currently available are not optimized for\nthe task of sentence representation, and, thus, likely to be suboptimal.\nSiamese CBOW handles this problem by training word embeddings directly for the\npurpose of being averaged. The underlying neural network learns word embeddings\nby predicting, from a sentence representation, its surrounding sentences. We\nshow the robustness of the Siamese CBOW model by evaluating it on 20 datasets\nstemming from a wide variety of sources.","url_abs":"http://arxiv.org/abs/1606.04640v1","url_pdf":"http://arxiv.org/pdf/1606.04640v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"siamese-cbow-optimizing-word-embeddings-for","repo_url":"https://bitbucket.org/TomKenter/siamese-cbow","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"siamese-cbow-optimizing-word-embeddings-for","repo_url":"https://github.com/junronglau/CS421_Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sentence-embeddings","task_name":"Sentence Embeddings"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1606.04640","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}