{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-character-word-compositional-neural","title":"A Character-Word Compositional Neural Language Model for Finnish","arxiv_id":"1612.03266","date":"2016-12-10","proceeding":null,"authors":["Matti Lankinen","Hannes Heikinheimo","Pyry Takala","Tapani Raiko","Juha Karhunen"],"abstract":"Inspired by recent research, we explore ways to model the highly\nmorphological Finnish language at the level of characters while maintaining the\nperformance of word-level models. We propose a new\nCharacter-to-Word-to-Character (C2W2C) compositional language model that uses\ncharacters as input and output while still internally processing word level\nembeddings. Our preliminary experiments, using the Finnish Europarl V7 corpus,\nindicate that C2W2C can respond well to the challenges of morphologically rich\nlanguages such as high out of vocabulary rates, the prediction of novel words,\nand growing vocabulary size. Notably, the model is able to correctly score\ninflectional forms that are not present in the training data and sample\ngrammatically and semantically correct Finnish sentences character by\ncharacter.","url_abs":"http://arxiv.org/abs/1612.03266v1","url_pdf":"http://arxiv.org/pdf/1612.03266v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-character-word-compositional-neural","repo_url":"https://github.com/milankinen/c2w2c","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}