{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/counterfactual-language-model-adaptation-for","title":"Counterfactual Language Model Adaptation for Suggesting Phrases","arxiv_id":"1710.01799","date":"2017-10-04","proceeding":"IJCNLP 2017 11","authors":["Kenneth C. Arnold","Kai-Wei Chang","Adam T. Kalai"],"abstract":"Mobile devices use language models to suggest words and phrases for use in\ntext entry. Traditional language models are based on contextual word frequency\nin a static corpus of text. However, certain types of phrases, when offered to\nwriters as suggestions, may be systematically chosen more often than their\nfrequency would predict. In this paper, we propose the task of generating\nsuggestions that writers accept, a related but distinct task to making accurate\npredictions. Although this task is fundamentally interactive, we propose a\ncounterfactual setting that permits offline training and evaluation. We find\nthat even a simple language model can capture text characteristics that improve\nacceptability.","url_abs":"http://arxiv.org/abs/1710.01799v1","url_pdf":"http://arxiv.org/pdf/1710.01799v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"counterfactual-language-model-adaptation-for","repo_url":"https://github.com/kcarnold/counterfactual-lm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":null,"task_name":"counterfactual"},{"task_slug":"model","task_name":"model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}