Text Normalization

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

27 shown of 27 papers with code (145 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Shallow Fusion of Weighted Finite-State Transducer and Language Model for Text Normalization
  29 Mar 2022 3 repositories listed
  First, a non-deterministic WFST outputs all normalization candidates, and then a neural language model picks the best one -- similar to shallow fusion for automatic speech recognition.
• Applying the Transformer to Character-level Transduction
  20 May 2020 3 repositories listed Syntology ran 2 of 5 samples · 3 unverified · 2 pointer-only (licence)
  The transformer has been shown to outperform recurrent neural network-based sequence-to-sequence models in various word-level NLP tasks.
• hinglishNorm -- A Corpus of Hindi-English Code Mixed Sentences for Text Normalization
  18 Oct 2020 2 repositories listed
  We present hinglishNorm -- a human annotated corpus of Hindi-English code-mixed sentences for text normalization task.
• A Large-Scale Comparison of Historical Text Normalization Systems
  3 Apr 2019 2 repositories listed
  There is no consensus on the state-of-the-art approach to historical text normalization.
• Encoder-Decoder Methods for Text Normalization
  1 Aug 2018 2 repositories listed
  Text normalization has been addressed with a variety of methods, most successfully with character-level statistical machine translation (CSMT).
• Digestion Algorithm in Hierarchical Symbolic Forests: A Fast Text Normalization Algorithm and Semantic Parsing Framework for Specific Scenarios and Lightweight Deployment
  18 Dec 2024 1 repository listed
  Text Normalization and Semantic Parsing have numerous applications in natural language processing, such as natural language programming, paraphrasing, data augmentation, constructing expert systems, text matching, and…
• VNLP: Turkish NLP Package
  2 Mar 2024 1 repository listed
  In this work, we present VNLP: the first dedicated, complete, open-source, well-documented, lightweight, production-ready, state-of-the-art Natural Language Processing (NLP) package for the Turkish language.
• Multi-Task Learning for Front-End Text Processing in TTS
  12 Jan 2024 1 repository listed
  We propose a multi-task learning (MTL) model for jointly performing three tasks that are commonly solved in a text-to-speech (TTS) front-end: text normalization (TN), part-of-speech (POS) tagging, and homograph…
• Extending Whisper with prompt tuning to target-speaker ASR
  13 Dec 2023 1 repository listed
  Target-speaker automatic speech recognition (ASR) aims to transcribe the desired speech of a target speaker from multi-talker overlapped utterances.
• Text normalization for low-resource languages: the case of Ligurian
  16 Jun 2022 1 repository listed
  Text normalization is a crucial technology for low-resource languages which lack rigid spelling conventions or that have undergone multiple spelling reforms.
• An End-to-end Chinese Text Normalization Model based on Rule-guided Flat-Lattice Transformer
  31 Mar 2022 1 repository listed
  Inspired by Flat-LAttice Transformer (FLAT), we propose an end-to-end Chinese text normalization model, which accepts Chinese characters as direct input and integrates expert knowledge contained in rules into the neural…
• indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages
  31 Mar 2022 1 repository listed
  Automatic Speech Recognition (ASR) generates text which is most of the times devoid of any punctuation.
• SciCap: Generating Captions for Scientific Figures
  22 Oct 2021 1 repository listed
  Researchers use figures to communicate rich, complex information in scientific papers.
• HUI-Audio-Corpus-German: A high quality TTS dataset
  11 Jun 2021 1 repository listed
  The increasing availability of audio data on the internet lead to a multitude of datasets for development and training of text to speech applications, based on neural networks.
• Proteno: Text Normalization with Limited Data for Fast Deployment in Text to Speech Systems
  15 Apr 2021 1 repository listed
  Developing Text Normalization (TN) systems for Text-to-Speech (TTS) on new languages is hard.
• NeMo Inverse Text Normalization: From Development To Production
  11 Apr 2021 1 repository listed
  Inverse text normalization (ITN) converts spoken-domain automatic speech recognition (ASR) output into written-domain text to improve the readability of the ASR output.
• An Unsupervised Normalization Algorithm for Noisy Text: A Case Study for Information Retrieval and Stance Detection
  9 Jan 2021 1 repository listed
  To enable tasks such as search/retrieval and classification over all the available data, we need robust algorithms for text normalization, i.
• Seq2Edits: Sequence Transduction Using Span-level Edit Operations
  23 Sep 2020 1 repository listed
  For text normalization, sentence fusion, and grammatical error correction, our approach improves explainability by associating each edit operation with a human-readable tag.
• Inducing Language-Agnostic Multilingual Representations
  20 Aug 2020 1 repository listed
  Cross-lingual representations have the potential to make NLP techniques available to the vast majority of languages in the world.
• How to Evaluate Word Representations of Informal Domain?
  12 Nov 2019 1 repository listed
  Diverse word representations have surged in most state-of-the-art natural language processing (NLP) applications.
• Dialect Text Normalization to Normative Standard Finnish
  1 Nov 2019 1 repository listed
  We compare different LSTMs and transformer models in terms of their effectiveness in normalizing dialectal Finnish into the normative standard Finnish.
• Adapting Sequence to Sequence models for Text Normalization in Social Media
  12 Apr 2019 1 repository listed
  Social media offer an abundant source of valuable raw data, however informal writing can quickly become a bottleneck for many natural language processing (NLP) tasks.
• A Character-Level Approach to the Text Normalization Problem Based on a New Causal Encoder
  6 Mar 2019 1 repository listed
  Text normalization is a ubiquitous process that appears as the first step of many Natural Language Processing problems.
• Text normalization using memory augmented neural networks
  31 May 2018 1 repository listed
  We perform text normalization, i.
• Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German
  30 Oct 2017 1 repository listed
  The goal of this work is to design a machine translation (MT) system for a low-resource family of dialects, collectively known as Swiss German, which are widely spoken in Switzerland but seldom written.
• RNN Approaches to Text Normalization: A Challenge
  31 Oct 2016 1 repository listed
  Though our conclusions are largely negative on this point, we are actually not arguing that the text normalization problem is intractable using an pure RNN approach, merely that it is not going to be something that can…
• Evaluating Informal-Domain Word Representations With UrbanDictionary
  27 Jun 2016 1 repository listed
  Existing corpora for intrinsic evaluation are not targeted towards tasks in informal domains such as Twitter or news comment forums.

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.