Papers › EventNarrative: A large-scale Event-centric Dataset for Knowledge Graph-to-Text Generation

EventNarrative: A large-scale Event-centric Dataset for Knowledge Graph-to-Text Generation

30 Oct 2021arXiv:2111.00276archive 2025-07-28

Anthony Colas, Ali Sadeghian, Yue Wang, Daisy Zhe Wang

We introduce EventNarrative, a knowledge graph-to-text dataset from publicly available open-world knowledge graphs. Given the recent advances in event-driven Information Extraction (IE), and that prior research on graph-to-text only focused on entity-driven KGs, this paper focuses on event-centric data. However, our data generation system can still be adapted to other other types of KG data. Existing large-scale datasets in the graph-to-text area are non-parallel, meaning there is a large disconnect between the KGs and text. The datasets that have a paired KG and text, are small scale and manually generated or generated without a rich ontology, making the corresponding graphs sparse. Furthermore, these datasets contain many unlinked entities between their KG and text pairs. EventNarrative consists of approximately 230,000 graphs and their corresponding natural language text, 6 times larger than the current largest parallel dataset. It makes use of a rich ontology, all of the KGs entities are linked to the text, and our manual annotations confirm a high data quality. Our aim is two-fold: help break new ground in event-centric research where data is lacking, and to give researchers a well-defined, large-scale dataset in order to better evaluate existing and future knowledge graph-to-text models. We also evaluate two types of baseline on EventNarrative: a graph-to-text specific model and two state-of-the-art language models, which previous work has shown to be adaptable to the knowledge graph-to-text domain.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

acolas1/EventNarrative officialpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

KG-to-Text GenerationKnowledge GraphsText GenerationWorld Knowledge

Datasets

Introduced by this paper, per the archive.

EventNarrative

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
KG-to-Text Generation EventNarrative BART BLEU 31.38 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative BART BertScore 93.12 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative BART CIDEr 3.31 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative BART ChrF++ 64.71 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative BART METEOR 26.68 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative BART ROUGE 62.65 #3 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter BLEU 30.78 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter BertScore 92.12 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter CIDEr 4.59 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter ChrF++ 47.91 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter METEOR 27.72 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative GraphWriter ROUGE 71.92 #6 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 BLEU 12.8 #7 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 BertScore 89.59 #7 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 CIDEr 3 #7 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 ChrF++ 56.76 #7 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 METEOR 22.77 #7 of 8 Archive leaderboard report
KG-to-Text Generation EventNarrative T5 ROUGE 52.06 #7 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections