Datasets › CoNLL-2009

CoNLL-2009

20 Apr 2012 archive 2025-07-28

The task builds on the CoNLL-2008 task and extends it to multiple languages. The core of the task is to predict syntactic and semantic dependencies and their labeling. Data is provided for both statistical training and evaluation, which extract these labeled dependencies from manually annotated treebanks such as the Penn Treebank for English, the Prague Dependency Treebank for Czech and similar treebanks for Catalan, Chinese, German, Japanese and Spanish languages, enriched with semantic relations (such as those captured in the Prop/Nombank and similar resources). Great effort has been devoted to provide the participants with a common and relatively simple data representation for all the languages, similar to the last year's English data.

Benchmarks archive 2025-07-28

All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Dependency Parsing CoNLL-2009 CRFPar LAS 86.52 Efficient Second-Order TreeCRF for Neural Dependency Parsing yzhangcs/parser +1 2 Compare
Semantic Role Labeling CoNLL-2009 Ours (High-Order model) F1 (Arg.) 90.2 End-to-end Semantic Role Labeling with Neural... scofield7419/TransitionSRL 1 Compare

Papers archive 2025-07-28

3 shown of 3 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 8. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
End-to-end Semantic Role Labeling with Neural Transition-based Model 1 1 2 Jan 2021 not harvested
Efficient Second-Order TreeCRF for Neural Dependency Parsing 2 1 3 May 2020 ran 2 of 3 samples (1 unverified)
Deep Biaffine Attention for Neural Dependency Parsing 26 1 6 Nov 2016 ran 3 of 19 samples (16 unverified; 2 pointer-only for licence)

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • CoNLL-2009

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections