Papers › Cross-Lingual Text Classification of Transliterated Hindi and Malayalam

Cross-Lingual Text Classification of Transliterated Hindi and Malayalam

31 Aug 2021arXiv:2108.13620archive 2025-07-28

Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit, Huzefa Rangwala

Transliteration is very common on social media, but transliterated text is not adequately handled by modern neural models for various NLP tasks. In this work, we combine data augmentation approaches with a Teacher-Student training scheme to address this issue in a cross-lingual transfer setting for fine-tuning state-of-the-art pre-trained multilingual language models such as mBERT and XLM-R. We evaluate our method on transliterated Hindi and Malayalam, also introducing new datasets for benchmarking on real-world scenarios: one on sentiment classification in transliterated Malayalam, and another on crisis tweet classification in transliterated Hindi and Malayalam (related to the 2013 North India and 2018 Kerala floods). Our method yielded an average improvement of +5.6% on mBERT and +4.7% on XLM-R in F1 scores over their strong baselines.

PaperPDFCode

Code

jitinkrishnan/transliteration-hindi-malayalam officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BenchmarkingClassificationCross-Lingual TransferData AugmentationSentiment AnalysisSentiment ClassificationText ClassificationTransliterationXLM-Rtext-classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

XLM-RmBERT

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections