Datasets › Universal Dependencies

Universal Dependencies

Introduced by Joakim Nivre et al. in Universal Dependencies v1: A Multilingual Treebank Collection1 Jan 2016 archive 2025-07-28

The Universal Dependencies (UD) project seeks to develop cross-linguistically consistent treebank annotation of morphology and syntax for multiple languages. The first version of the dataset was released in 2015 and consisted of 10 treebanks over 10 languages. Version 2.7 released in 2020 consists of 183 treebanks over 104 languages. The annotation consists of UPOS (universal part-of-speech tags), XPOS (language-specific part-of-speech tags), Feats (universal morphological features), Lemmas, dependency heads and universal dependency labels.

Source: Evaluating Contextualized Embeddings on 54 Languagesin POS Tagging, Lemmatization and Dependency Parsing Image Source: https://universaldependencies.org/introduction.html

Benchmarks archive 2025-07-28

All 5 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Dependency Parsing Universal Dependencies UDPipe 2.0 + mBERT + FLAIR LAS 84.60 Evaluating Contextualized Embeddings on 54 Languages in... — 6 Compare
Part-Of-Speech Tagging UD BiLSTM-LAN Avg accuracy 96.88 Hierarchically-Refined Label Attention Network for... Nealcly/LAN +1 5 Compare
Cross-lingual zero-shot dependency parsing Universal Dependency Treebank Cross-Lingual ELMo LAS 77.3 Cross-Lingual Alignment of Contextual Word Embeddings,... TalSchuster/CrossLingualContextualEmb +1 3 Compare
Dependency Parsing Universal Dependency Treebank Stanza Macro F1 81.13 Stanza: A Python Natural Language Processing Toolkit for... stanfordnlp/stanza +4 1 Compare
Language Identification Universal Dependencies Apple bi-LSTM Accuracy 86.93 A reproduction of Apple's bi-directional LSTM models for... AU-DIS/LSTM_langid 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 16 · with a code link: 12 · where Syntology ran a sample: 4 (3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (4 of 16 with a benchmark row: 3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 16 of 16 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 520. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
A reproduction of Apple's bi-directional LSTM models for language identification in short strings 1 1 11 Feb 2021 not harvested
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages 5 1 16 Mar 2020 community repositories only · 16 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 14 unverified (28 pointer-only for licence)
Hierarchically-Refined Label Attention Network for Sequence Labeling 2 1 23 Aug 2019 not harvested
Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing 0 1 20 Aug 2019 not harvested
Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation 1 1 4 Jun 2019 not harvested
75 Languages, 1 Model: Parsing Universal Dependencies Universally 3 1 3 Apr 2019 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing 2 1 25 Feb 2019 official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified
Universal Dependency Parsing from Scratch 1 1 29 Jan 2019 not harvested
Turku Neural Parser Pipeline: An End-to-End System for the CoNLL 2018 Shared Task 0 1 1 Oct 2018 not harvested
UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task 0 1 1 Oct 2018 not harvested
Towards Better UD Parsing: Deep Contextualized Word Embeddings, Ensemble, and Treebank Concatenation 1 1 9 Jul 2018 not harvested
Robust Multilingual Part-of-Speech Tagging via Adversarial Training 1 1 14 Nov 2017 not harvested
A Novel Neural Network Model for Joint POS Tagging and Graph-based Dependency Parsing 1 1 16 May 2017 not harvested
Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss 3 1 19 Apr 2016 official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
A Representation Learning Framework for Multi-Source Transfer Parsing 0 1 5 Mar 2016 not harvested
Many Languages, One Parser 1 1 4 Feb 2016 not harvested

Dataset loaders archive 2025-07-28

6 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Various (see link)

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • UD
  • Universal Dependencies
  • Universal Dependency Treebank
  • Universal Dependencies v2.8
  • universal_dependencies sk_snk
  • Maltese Universal Dependencies Treebank (MUDT)
  • UD Danish DDT

7 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections