Papers › Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts

Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts

24 Aug 2021arXiv:2108.10939archive 2025-07-28

Charangan Vasantharajan, Uthayasanker Thayasivam

Offensive Language detection in social media platforms has been an active field of research over the past years. In non-native English spoken countries, social media users mostly use a code-mixed form of text in their posts/comments. This poses several challenges in the offensive content identification tasks, and considering the low resources available for Tamil, the task becomes much harder. The current study presents extensive experiments using multiple deep learning, and transfer learning models to detect offensive content on YouTube. We propose a novel and flexible approach of selective translation and transliteration techniques to reap better results from fine-tuning and ensembling multilingual transformer networks like BERT, Distil- BERT, and XLM-RoBERTa. The experimental results showed that ULMFiT is the best model for this task. The best performing models were ULMFiT and mBERTBiLSTM for this Tamil code-mix dataset instead of more popular transfer learning models such as Distil- BERT and XLM-RoBERTa and hybrid deep learning models. The proposed model ULMFiT and mBERTBiLSTM yielded good results and are promising for effective offensive speech identification in low-resourced languages.

PaperPDFCode

Code

chaarangan/odl-tamil-sn officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Language IdentificationTransfer LearningTranslationTransliteration

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AWD-LSTMActivation RegularizationAdamAttentionAttention DropoutBERTDense ConnectionsDiscriminative Fine-TuningDropConnectDropoutEmbedding DropoutLSTMLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSigmoid ActivationSlanted Triangular Learning RatesSoftmaxTanh ActivationTemporal Activation RegularizationULMFiTVariational DropoutWeight DecayWeight TyingWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections