Browse State-of-the-Art › Multilingual NLP
Multilingual NLP
42 papers with code · 0 benchmarks · 8 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
8 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 96 · with a code link: 42 · where Syntology ran a sample: 8 (8 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (8 of 96 tagged: 8 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 96 of 96, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Nov 2019 35 repositories listed Syntology official (archive's flag): 12 ran · 40 ran (of which 13 constructed an object rather than computing a result; 35 with no instrument failure: 4 honoured, 1 violated, 30 with no contract checked; 5 where Syntology's instrument failed) · 19 unverified (of 59 harvested samples) · 52 pointer-only (licence)We also present a detailed empirical analysis of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and…
-
9 Nov 2022 7 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 11 harvested samples)Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions.
-
3 Jul 2020 6 repositories listedWhile BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings…
-
2 May 2024 3 repositories listedThis paper introduces UQA, a novel dataset for question answering and text comprehension in Urdu, a low-resource language with over 70 million native speakers.
-
6 Feb 2024 2 repositories listedWe recommend future work to include an operationalization of 'typological diversity' that empirically justifies the diversity of language samples.
-
22 May 2023 2 repositories listedColexNet's nodes are concepts and its edges are colexifications.
-
6 May 2021 2 repositories listedThe introduction of pretrained cross-lingual language models brought decisive improvements to multilingual NLP tasks.
-
27 Jan 2020 2 repositories listedParallel text is required for building high-quality machine translation (MT) systems, as well as for other multilingual NLP applications.
-
3 Oct 2017 2 repositories listedMultilinguality is gradually becoming ubiquitous in the sense that more and more researchers have successfully shown that using additional languages help improve the results in many Natural Language Processing tasks.
-
18 Jun 2024 1 repository listedRapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations.
-
13 Jun 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)Performance prediction is a method to estimate the performance of Language Models (LMs) on various Natural Language Processing (NLP) tasks, mitigating computational costs associated with model capacity and data for…
-
7 May 2024 1 repository listedHowever, Fairlearn's metrics suggest that the SVM approaches equitable levels with a demographic parity ratio of 0.
-
29 Apr 2024 1 repository listedThis study investigates the factors influencing the performance of multilingual large language models (MLLMs) across diverse languages.
-
6 Mar 2024 1 repository listedTypologically diverse benchmarks are increasingly created to track the progress achieved in multilingual NLP.
-
15 Feb 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)Recent work has shown that, while large language models (LLMs) demonstrate strong word translation or bilingual lexicon induction (BLI) capabilities in few-shot setups, they still cannot match the performance of…
-
21 Oct 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Bilingual Lexicon Induction (BLI) is a core task in multilingual NLP that still, to a large extent, relies on calculating cross-lingual word representations.
-
13 Oct 2023 1 repository listedThis study presents a large multi-modal Bangla YouTube clickbait dataset consisting of 253, 070 data points collected through an automated process using the YouTube API and Python web automation frameworks.
-
12 Oct 2023 1 repository listedBy comparing the performance of CapsNet to that of other architectures, such as DistilBERT, Vanilla Neural Networks (VNN), and Convolutional Neural Networks (CNN), we were able to achieve an accuracy of 90.
-
16 Sep 2023 1 repository listedFoundational large language models (LLMs) can be instruction-tuned to perform open-domain question answering, facilitating applications like chat assistants.
-
19 May 2023 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)We evaluate commonly used models on the benchmark.
-
15 May 2023 1 repository listedThis paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India.
-
11 May 2023 1 repository listedWhile a large body of work leveraged MMTs to mine parallel data and induce bilingual document embeddings, much less effort has been devoted to training general-purpose (massively) multilingual document encoder that can…
-
3 Apr 2023 1 repository listedMultilingual pre-training on monolingual data ignores the availability of parallel data in many language pairs.
-
30 Oct 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)This crucial step is done via 1) creating a word similarity dataset, comprising positive word pairs (i. e., true translations) and hard negative pairs induced from the original CLWE space, and then 2) fine-tuning an…
-
10 Oct 2022 1 repository listedTimely and effective response to humanitarian crises requires quick and accurate analysis of large amounts of text data - a process that can highly benefit from expert-assisted NLP systems trained on validated and…
-
24 Jun 2022 1 repository listedOur model sets the new state of the art performance of 67.
-
1 Jun 2022 1 repository listedWe present the TeDDi sample, a diversity sample of text data for language comparison and multilingual Natural Language Processing.
-
15 Mar 2022 1 repository listed Syntology official (archive's flag): 2 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 4 pointer-only (licence)At Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
-
16 Nov 2021 1 repository listedAs Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
-
1 Nov 2021 1 repository listedMultilingual Named Entity Recognition (NER) is a key intermediate task which is needed in many areas of NLP.
-
1 Jun 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
12 May 2021 1 repository listed
-
12 Apr 2021 1 repository listed
-
1 Apr 2021 1 repository listed
-
14 Jan 2021 1 repository listed
-
9 Jan 2021 1 repository listed
-
Manual Clustering and Spatial Arrangement of Verbs for Multilingual Evaluation and Typology Analysis1 Dec 2020 1 repository listed
-
14 Oct 2020 1 repository listed
-
1 Jul 2020 1 repository listed
-
4 Jun 2019 1 repository listed
-
27 Aug 2018 1 repository listed
-
Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Transfer in Sense-Aware Tasks30 May 2025 0 repositories listed
-
SenWiCh: Sense-Annotation of Low-Resource Languages for WiC using Hybrid Methods29 May 2025 0 repositories listed
-
LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization21 May 2025 0 repositories listed
-
Shared Path: Unraveling Memorization in Multilingual LLMs through Language Similarities21 May 2025 0 repositories listed
-
Cross-Linguistic Transfer in Multilingual NLP: The Role of Language Families and Morphology20 May 2025 0 repositories listed
-
HausaNLP: Current Status, Challenges and Future Directions for Hausa Natural Language Processing20 May 2025 0 repositories listed
-
Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025 0 repositories listed
-
Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting15 Apr 2025 0 repositories listed
-
19 Mar 2025 0 repositories listed
-
Code-Mixed Telugu-English Hate Speech Detection15 Feb 2025 0 repositories listed
-
How does a Multilingual LM Handle Multiple Languages?6 Feb 2025 0 repositories listed
-
How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP8 Nov 2024 0 repositories listed
-
Don't Touch My Diacritics31 Oct 2024 0 repositories listed
-
SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval28 Oct 2024 0 repositories listed
-
Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilities9 Jul 2024 0 repositories listed
-
Dravidian language family through Universal Dependencies lens20 Jun 2024 0 repositories listed
-
On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations?20 Jun 2024 0 repositories listed
-
Leveraging Large Language Models to Measure Gender Representation Bias in Gendered Language Corpora19 Jun 2024 0 repositories listed
-
Benchmarking the Performance of Pre-trained LLMs across Urdu NLP Tasks24 May 2024 0 repositories listed
-
A Reproducibility Study on Quantifying Language Similarity: The Impact of Missing Values in the URIEL Knowledge Base17 May 2024 0 repositories listed
-
Introducing Syllable Tokenization for Low-resource Languages: A Case Study with Swahili26 Mar 2024 0 repositories listed
-
Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Models15 Mar 2024 0 repositories listed
-
Patterns of Persistence and Diffusibility across the World's Languages3 Jan 2024 0 repositories listed
-
Multilingual Word Embeddings for Low-Resource Languages using Anchors and a Chain of Related Languages21 Nov 2023 0 repositories listed
-
Multi-teacher Distillation for Multilingual Spelling Correction20 Nov 2023 0 repositories listed
-
A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems19 Oct 2023 0 repositories listed
-
Zero-shot Cross-lingual Transfer without Parallel Corpus7 Oct 2023 0 repositories listed
-
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer19 Sep 2023 0 repositories listed
-
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning12 Apr 2023 0 repositories listed
-
How Do Multilingual Encoders Learn Cross-lingual Representation?12 Jul 2022 0 repositories listed
-
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages12 May 2022 0 repositories listed
-
Challenges and Strategies in Cross-Cultural NLP18 Mar 2022 0 repositories listed
-
Predicting the Performance of Multilingual NLP Models17 Oct 2021 0 repositories listed
-
Fairness in Representation for Multilingual NLP: Insights from Controlled Experiments on Conditional Language Modeling29 Sep 2021 0 repositories listed
-
Discovering Representation Sprachbund For Multilingual Pre-Training1 Sep 2021 0 repositories listed
-
nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?1 Aug 2021 0 repositories listed
-
ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus14 Jul 2021 0 repositories listed
-
Challenges and Considerations with Code-Mixed NLP for Multilingual Societies15 Jun 2021 0 repositories listed
-
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?3 Jun 2021 0 repositories listed
-
A Multilingual Modeling Method for Span-Extraction Reading Comprehension31 May 2021 0 repositories listed
-
17 Apr 2021 0 repositories listed
-
Representation and Bias in Multilingual NLP: Insights from Controlled Experiments on Conditional Language Modeling1 Jan 2021 0 repositories listed
-
Coreference Strategies in English-German Translation1 Dec 2020 0 repositories listed
-
I’ve got a construction looks funny – representing and recovering non-standard constructions in UD1 Dec 2020 0 repositories listed
-
Pragmatic information in translation: a corpus-based study of tense and mood in English and German10 Jul 2020 0 repositories listed
-
Automatic Parallel Corpus Creation for Hindi-English News Translation Task24 Jan 2019 0 repositories listed
-
URIEL and lang2vec: Representing languages as typological, geographical, and phylogenetic vectors1 Apr 2017 0 repositories listed
-
The MultiTal NLP tool infrastructure1 Dec 2016 0 repositories listed
-
Survey on the Use of Typological Information in Natural Language Processing11 Oct 2016 0 repositories listed
-
DBpedia Abstracts: A Large-Scale, Open, Multilingual NLP Training Corpus1 May 2016 0 repositories listed
-
Development of the Multilingual Semantic Annotation System1 May 2015 0 repositories listed
-
IXA pipeline: Efficient and Ready to Use Multilingual NLP tools1 May 2014 0 repositories listed
-
Semantic Clustering of Pivot Paraphrases1 May 2014 0 repositories listed
-
Polyglot: Distributed Word Representations for Multilingual NLP5 Jul 2013 0 repositories listed
Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections