Papers › WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization

WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization

7 Oct 2020Findings of the Association for Computational Linguistics 2020arXiv:2010.03093archive 2025-07-28

Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen McKeown

We introduce WikiLingua, a large-scale, multilingual dataset for the evaluation of crosslingual abstractive summarization systems. We extract article and summary pairs in 18 languages from WikiHow, a high quality, collaborative resource of how-to guides on a diverse set of topics written by human authors. We create gold-standard article-summary alignments across languages by aligning the images that are used to describe each how-to step in an article. As a set of baselines for further studies, we evaluate the performance of existing cross-lingual abstractive summarization methods on our dataset. We further propose a method for direct crosslingual summarization (i.e., without requiring translation at inference time) by leveraging synthetic data and Neural Machine Translation as a pre-training step. Our method significantly outperforms the baseline approaches, while being more cost efficient during inference.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

esdurmus/Wikilingua officialmentioned in papermentioned on GitHubCC0-1.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Abstractive Text SummarizationCross-Lingual Abstractive SummarizationMachine TranslationTranslation

Datasets

Introduced by this paper, per the archive.

WikiLingua

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections