{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/to-normalize-or-not-to-normalize-the-impact","title":"To Normalize, or Not to Normalize: The Impact of Normalization on Part-of-Speech Tagging","arxiv_id":"1707.05116","date":"2017-07-17","proceeding":"WS 2017 9","authors":["Rob van der Goot","Barbara Plank","Malvina Nissim"],"abstract":"Does normalization help Part-of-Speech (POS) tagging accuracy on noisy,\nnon-canonical data? To the best of our knowledge, little is known on the actual\nimpact of normalization in a real-world scenario, where gold error detection is\nnot available. We investigate the effect of automatic normalization on POS\ntagging of tweets. We also compare normalization to strategies that leverage\nlarge amounts of unlabeled data kept in its raw form. Our results show that\nnormalization helps, but does not add consistently beyond just word embedding\nlayer initialization. The latter approach yields a tagging model that is\ncompetitive with a Twitter state-of-the-art tagger.","url_abs":"http://arxiv.org/abs/1707.05116v1","url_pdf":"http://arxiv.org/pdf/1707.05116v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"to-normalize-or-not-to-normalize-the-impact","repo_url":"https://github.com/bplank/wnut-2017-pos-norm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"pos","task_name":"POS"},{"task_slug":"pos-tagging","task_name":"POS Tagging"},{"task_slug":"part-of-speech-tagging","task_name":"Part-Of-Speech Tagging"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1707.05116","atlas_url":"https://app.syntology.ai/?focus=1707.05116","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}