Papers › HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection

HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection

22 Aug 2020arXiv:2008.09820archive 2025-07-28

Meghana Bhange, Nirant Kasliwal

Sentiment analysis for code-mixed social media text continues to be an under-explored area. This work adds two common approaches: fine-tuning large transformer models and sample efficient methods like ULMFiT. Prior work demonstrates the efficacy of classical ML methods for polarity detection. Fine-tuned general-purpose language representation models, such as those of the BERT family are benchmarked along with classical machine learning and ensemble methods. We show that NB-SVM beats RoBERTa by 6.2% (relative) F1. The best performing model is a majority-vote ensemble which achieves an F1 of 0.707. The leaderboard submission was made under the codalab username nirantk, with F1 of 0.689.

PaperPDFCode

Code

NirantK/Hinglish officialmentioned in paperpytorch report
makcedward/nlpaug mentioned in papermentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BIG-bench Machine LearningSentiment Analysis

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AWD-LSTMActivation RegularizationAdamAttentionAttention DropoutBERTDense ConnectionsDiscriminative Fine-TuningDropConnectDropoutEmbedding DropoutLSTMLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionRoBERTaSigmoid ActivationSlanted Triangular Learning RatesSoftmaxTanh ActivationTemporal Activation RegularizationULMFiTVariational DropoutWeight DecayWeight TyingWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections