Datasets › CoNLL 2003

CoNLL 2003

Introduced by Erik F. Tjong Kim Sang et al. in Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition12 Jun 2003 archive 2025-07-28

CoNLL-2003 is a named entity recognition dataset released as a part of CoNLL-2003 shared task: language-independent named entity recognition. The data consists of eight files covering two languages: English and German. For each of the languages there is a training file, a development file, a test file and a large file with unannotated data.

The English data was taken from the Reuters Corpus. This corpus consists of Reuters news stories between August 1996 and August 1997. For the training and development set, ten days worth of data were taken from the files representing the end of August 1996. For the test set, the texts were from December 1996. The preprocessed raw data covers the month of September 1996.

The text for the German data was taken from the ECI Multilingual Text Corpus. This corpus consists of texts in many languages. The portion of data that was used for this task, was extracted from the German newspaper Frankfurter Rundshau. All three of the training, development and test sets were taken from articles written in one week at the end of August 1992. The raw data were taken from the months of September to December 1992.

English data Articles Sentences Tokens LOC MISC ORG PER
Training set 946 14,987 203,621 7140 3438 6321 6600
Development set 216 3,466 51,362 1837 922 1341 1842
Test set 231 3,684 46,435 1668 702 1661 1617

Number of articles, sentences, tokens and entities (locations, miscellaneous, organizations, and persons) in English data files.

German data Articles Sentences Tokens LOC MISC ORG PER
Training set 553 12,705 206,931 4363 2288 2427 2773
Development set 201 3,068 51,444 1181 1010 1241 1401
Test set 155 3,160 51,943 1035 670 773 1195

Number of articles, sentences, tokens and entities (locations, miscellaneous, organizations, and persons) in German data files.

Benchmarks archive 2025-07-28

All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

papers with a benchmark row: 6 · with a code link: 4 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran: none of the 6 papers with a benchmark row has a Syntology run on record

Page 1 of 1: papers 1 to 6 of 6 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 755. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

Dataset loaders archive 2025-07-28

5 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • Unknown
  • ConLL 2003
  • conll2003
  • CoNLL 2003 NER dev
  • CoNLL 2003 (German) Revised
  • CONLL 2003 German
  • CoNLL 2003 (German)
  • CoNLL 2003 (English)
  • CoNLL03
  • CoNLL 2003

10 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections