{"url":"/dataset/tempeval-3","name":"TempEval-3","full_name":"TempEval-3: events, times, and temporal relations","description_markdown":"Within the SemEval-2013 evaluation exercise, the TempEval-3 shared task aims to advance research on temporal information processing. It follows on from TempEval-1 and -2, with: a three-part structure covering temporal expression, event, and temporal relation extraction; a larger dataset; and new single measures to rank systems – in each task and in general.\r\n\r\nWe present TempEval-3 Silver data, with 666K words, and TempEval-3 Platinum, an evaluation set with 6K words. Documents are annotation with EVENT and TIMEX3 spans and also TLINKs, following the TimeML standard.","description_withheld":null,"homepage":"https://aclanthology.org/S13-2001/","introduced_date":"2012-06-22","introduced_date_note":null,"introduced_by":{"paper":"/paper/tempeval-3-evaluating-events-time-expressions","title":"TempEval-3: Evaluating Events, Time Expressions, and Temporal Relations","first_author":"Naushad UzZaman","url":null},"license":{"name":"CC-BY","url":"https://creativecommons.org/licenses/by/4.0/"},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Temporal Information Extraction","url":"/task/temporal-information-extraction","datasets_with_task":"/datasets/task/temporal-information-extraction"},{"name":"Temporal Tagging","url":"/task/temporal-tagging","datasets_with_task":"/datasets/task/temporal-tagging"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["TempEval-3"],"data_loaders":[],"num_papers_in_archive":18,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/temporal-tagging-on-tempeval-3","task":"Temporal Tagging","dataset_variant":"TempEval-3","rows":5,"metrics":[" Strict Detection (Pr.)"," Strict Detection (Re.)","Strict Detection (F1)","Relaxed Detection (Pr.)","Relaxed Detection (Re.)","Relaxed Detection (F1)","Type","F1"],"first_row_in_archive_order":{"model":"R2R","paper":"/paper/bert-got-a-date-introducing-transformers-to","metrics":{" Strict Detection (Pr.)":"96.37"," Strict Detection (Re.)":"96.37","Relaxed Detection (F1)":"100","Relaxed Detection (Pr.)":"100","Relaxed Detection (Re.)":"100","Strict Detection (F1)":"96.37","Type":"90.43"},"code_links":[{"title":"satya77/Transformer_Temporal_Tagger","url":"https://github.com/satya77/Transformer_Temporal_Tagger"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/temporal-information-extraction-on-tempeval-3","task":"Temporal Information Extraction","dataset_variant":"TempEval-3","rows":2,"metrics":["Temporal awareness"],"first_row_in_archive_order":{"model":"Ning et al.","paper":"/paper/a-structured-learning-approach-to-temporal-1","metrics":{"Temporal awareness":"67.2"},"code_links":[]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers_with_a_benchmark_row":[{"paper":"/paper/bert-got-a-date-introducing-transformers-to","title":"BERT got a Date: Introducing Transformers to Temporal Tagging","date":"2021-09-30","rows_on_this_dataset":4,"code_links":1,"syntology":null},{"paper":"/paper/adversarial-alignment-of-multilingual-models","title":"Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text","date":"2020-05-19","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/a-structured-learning-approach-to-temporal-1","title":"A Structured Learning Approach to Temporal Relation Extraction","date":"2019-06-12","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/cleartk-timeml-a-minimalist-approach-to","title":"ClearTK-TimeML: A minimalist approach to TempEval 2013","date":"2013-06-01","rows_on_this_dataset":1,"code_links":0,"syntology":null}],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}