{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/character-eyes-seeing-language-through","title":"Character Eyes: Seeing Language through Character-Level Taggers","arxiv_id":"1903.05041","date":"2019-03-12","proceeding":"WS 2019 8","authors":["Yuval Pinter","Marc Marone","Jacob Eisenstein"],"abstract":"Character-level models have been used extensively in recent years in NLP\ntasks as both supplements and replacements for closed-vocabulary token-level\nword representations. In one popular architecture, character-level LSTMs are\nused to feed token representations into a sequence tagger predicting\ntoken-level annotations such as part-of-speech (POS) tags. In this work, we\nexamine the behavior of POS taggers across languages from the perspective of\nindividual hidden units within the character LSTM. We aggregate the behavior of\nthese units into language-level metrics which quantify the challenges that\ntaggers face on languages with different morphological properties, and identify\nlinks between synthesis and affixation preference and emergent behavior of the\nhidden tagger layer. In a comparative experiment, we show how modifying the\nbalance between forward and backward hidden units affects model arrangement and\nperformance in these types of languages.","url_abs":"http://arxiv.org/abs/1903.05041v1","url_pdf":"http://arxiv.org/pdf/1903.05041v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"character-eyes-seeing-language-through","repo_url":"https://github.com/ruyimarone/character-eyes","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"pos","task_name":"POS"}],"methods":[{"method_slug":"lstm","method_name":"LSTM"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"tanh-activation","method_name":"Tanh Activation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}