{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/enabling-robust-grammatical-error-correction","title":"Enabling Robust Grammatical Error Correction in New Domains: Data Sets, Metrics, and Analyses","arxiv_id":null,"date":"2019-03-01","proceeding":"TACL 2019 3","authors":["Courtney Napoles","Maria N{\\u{a}}dejde","Joel Tetreault"],"abstract":"Until now, grammatical error correction (GEC) has been primarily evaluated on text written by non-native English speakers, with a focus on student essays. This paper enables GEC development on text written by native speakers by providing a new data set and metric. We present a multiple-reference test corpus for GEC that includes 4,000 sentences in two new domains (formal and informal writing by native English speakers) and 2,000 sentences from a diverse set of non-native student writing. We also collect human judgments of several GEC systems on this new test set and perform a meta-evaluation, assessing how reliable automatic metrics are across these domains. We find that commonly used GEC metrics have inconsistent performance across domains, and therefore we propose a new ensemble metric that is robust on all three domains of text.","url_abs":"https://aclanthology.org/Q19-1032","url_pdf":"https://aclanthology.org/Q19-1032.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"grammatical-error-correction","task_name":"Grammatical Error Correction"}],"methods":[],"datasets_introduced":[{"slug":"gmeg-wiki","name":"GMEG-wiki","full_name":""},{"slug":"gmeg-yahoo","name":"GMEG-yahoo","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}