{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/continual-learning-for-sentence","title":"Continual Learning for Sentence Representations Using Conceptors","arxiv_id":"1904.09187","date":"2019-04-18","proceeding":"NAACL 2019 6","authors":["Tianlin Liu","Lyle Ungar","João Sedoc"],"abstract":"Distributed representations of sentences have become ubiquitous in natural\nlanguage processing tasks. In this paper, we consider a continual learning\nscenario for sentence representations: Given a sequence of corpora, we aim to\noptimize the sentence encoder with respect to the new corpus while maintaining\nits accuracy on the old corpora. To address this problem, we propose to\ninitialize sentence encoders with the help of corpus-independent features, and\nthen sequentially update sentence encoders using Boolean operations of\nconceptor matrices to learn corpus-dependent features. We evaluate our approach\non semantic textual similarity tasks and show that our proposed sentence\nencoder can continually learn features from new corpora while retaining its\ncompetence on previously encountered corpora.","url_abs":"http://arxiv.org/abs/1904.09187v1","url_pdf":"http://arxiv.org/pdf/1904.09187v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"continual-learning-for-sentence","repo_url":"https://github.com/liutianlin0121/contSentEmbed","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"},{"task_slug":"semantic-textual-similarity","task_name":"Semantic Textual Similarity"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1904.09187","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}