Dialect Identification

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

3 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 33 papers with code (189 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• GlotLID: Language Identification for Low-Resource Languages
  24 Oct 2023 3 repositories listed
  Several recent papers have published good solutions for language identification (LID) for about 300 high-resource and medium-resource languages.
• Resource-Aware Arabic LLM Creation: Model Adaptation, Integration, and Multi-Domain Testing
  23 Dec 2024 1 repository listed
  This paper presents a novel approach to fine-tuning the Qwen2-1.
• Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challenges
  4 Oct 2024 1 repository listed
  To provide benchmarks and simultaneously demonstrate the challenges of our dataset, we fine-tune state-of-the-art pre-trained models for two downstream tasks: (1) Dialect identification and (2) Speech recognition.
• Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data
  19 Mar 2024 1 repository listed
  Named Entity Recognition (NER) is a fundamental task to extract key information from texts, but annotated resources are scarce for dialects.
• ArTST: Arabic Text and Speech Transformer
  25 Oct 2023 1 repository listed
  We present ArTST, a pre-trained Arabic text and speech transformer for supporting open-source speech technologies for the Arabic language.
• Arabic Dialect Identification under Scrutiny: Limitations of Single-label Classification
  20 Oct 2023 1 repository listed
  Automatic Arabic Dialect Identification (ADI) of text has gained great popularity since it was introduced in the early 2010s.
• ALDi: Quantifying the Arabic Level of Dialectness of Text
  20 Oct 2023 1 repository listed
  Transcribed speech and user-generated text in Arabic typically contain a mixture of Modern Standard Arabic (MSA), the standardized language taught in schools, and Dialectal Arabic (DA), used in daily communications.
• DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic Rules
  22 May 2023 1 repository listed
  We show that DADA is effective for both single task and instruction finetuned language models, offering an extensible and interpretable framework for adapting existing LLMs to different English dialects.
• North Sámi Dialect Identification with Self-supervised Speech Models
  19 May 2023 1 repository listed
  The North S\'{a}mi (NS) language encapsulates four primary dialectal variants that are related but that also have differences in their phonology, morphology, and vocabulary.
• A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-Trained General-Purpose Speech Model
  18 May 2023 1 repository listed
  In this work, we explore Parameter-Efficient-Learning (PEL) techniques to repurpose a General-Purpose-Speech (GSM) model for Arabic dialect identification (ADI).
• Two-stage Pipeline for Multilingual Dialect Detection
  6 Mar 2023 1 repository listed
  Our proposed approach consists of a two-stage system and outperforms other participants' systems and previous works in this domain.
• FreCDo: A Large Corpus for French Cross-Domain Dialect Identification
  15 Dec 2022 1 repository listed
  We present a novel corpus for French dialect identification comprising 413, 522 French text samples collected from public news websites in Belgium, Canada, France and Switzerland.
• A Benchmark Study of Contrastive Learning for Arabic Social Meaning
  22 Oct 2022 1 repository listed
  Contrastive learning (CL) brought significant progress to various NLP tasks.
• NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Task
  18 Oct 2022 1 repository listed
  We describe findings of the third Nuanced Arabic Dialect Identification Shared Task (NADI 2022).
• Findings of the VarDial Evaluation Campaign 2022
  1 Oct 2022 1 repository listed
  This report presents the results of the shared tasks organized as part of the VarDial Evaluation Campaign 2022.
• Italian Language and Dialect Identification and Regional French Variety Detection using Adaptive Naive Bayes
  1 Oct 2022 1 repository listed
  This article describes the language identification approach used by the SUKI team in the Identification of Languages and Dialects of Italy and the French Cross-Domain Dialect Identification shared tasks organized as…
• Distilling the Knowledge of Romanian BERTs Using Multiple Teachers
  23 Dec 2021 1 repository listed
  In this work, we introduce three light and fast versions of distilled BERT models for the Romanian language: Distil-BERT-base-ro, Distil-RoBERT-base, and DistilMulti-BERT-base-ro.
• Finnish Dialect Identification: The Effect of Audio and Text
  6 Nov 2021 1 repository listed
  Finnish is a language with multiple dialects that not only differ from each other in terms of accent (pronunciation) but also in terms of morphological forms and lexical choice.
• Dynamic Multi-scale Convolution for Dialect Identification
  2 Aug 2021 1 repository listed
  To address this issue, we propose a new architecture, named dynamic multi-scale convolution, which consists of dynamic kernel convolution, local multi-scale learning, and global multi-scale pooling.
• AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News and Hate Speech Detection Dataset
  7 May 2021 1 repository listed
  This paper releases "AraCOVID19-MFH" a manually annotated multi-label Arabic COVID-19 fake news and hate speech detection dataset.
• Comparing the Performance of CNNs and Shallow Models for Language Identification
  1 Apr 2021 1 repository listed
  In this work we compare the performance of convolutional neural networks and shallow models on three out of the four language identification shared tasks proposed in the VarDial Evaluation Campaign 2021.
• NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Task
  4 Mar 2021 1 repository listed
  This Shared Task includes four subtasks: country-level Modern Standard Arabic (MSA) identification (Subtask 1.
• Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task
  1 Mar 2021 1 repository listed
  Tasks are to identify the geographic origin of short Dialectal (DA) and Modern Standard Arabic (MSA) utterances at the levels of both country and province.
• Arabic Dialect Identification Using BERT Fine-Tuning
  1 Dec 2020 1 repository listed
  In the last few years, deep learning has proved to be a very effective paradigm to discover patterns in large data sets.
• A dual-encoding system for dialect classification
  1 Dec 2020 1 repository listed
  In this paper we present the architecture, processing pipeline and results of the ensemble model developed for Romanian Dialect Identification task.
• Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments
  10 Oct 2020 1 repository listed
  Although the prediction of dialects is an important language processing task, with a wide range of applications, existing work is largely limited to coarse-grained varieties.
• The Unreasonable Effectiveness of Machine Learning in Moldavian versus Romanian Dialect Identification
  30 Jul 2020 1 repository listed
  We conduct a subjective evaluation by human annotators, showing that humans attain much lower accuracy rates compared to machine learning (ML) models.
• Multi-Dialect Arabic BERT for Country-Level Dialect Identification
  10 Jul 2020 1 repository listed
  Our winning solution itself came in the form of an ensemble of different training iterations of our pre-trained BERT model, which achieved a micro-averaged F1-score of 26.
• CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing
  1 May 2020 1 repository listed
  We present CAMeL Tools, a collection of open-source tools for Arabic natural language processing in Python.
• Speech Recognition Challenge in the Wild: Arabic MGB-3
  21 Sep 2017 1 repository listed
  Two hours of audio per dialect were released for development and a further two hours were used for evaluation.