Papers › TNT-NLG, System 1: Using a statistical NLG to massively augment crowd-sourced data for...
TNT-NLG, System 1: Using a statistical NLG to massively augment crowd-sourced data for neural generation
Shereen Oraby, Lena Reed, Shubhangi Tandon, Stephanie Lukin, Marilyn A. Walker
Ever since the successful application of sequence to sequence learning for neural machine translation systems (Sutskever et al., 2014), interest has surged in its applicability towards language generation in other problem domains. In the area of natural language generation (NLG), there has been a great deal of interest in end-to-end (E2E) neural models that learn and generate natural language sentence realizations in one step. In this paper, we present TNT-NLG System 1, our first system submission to the E2E NLG Challenge, where we generate natural language (NL) realizations from meaning representations (MRs) in the restaurant domain by massively expanding the training dataset. We develop two models for this system, based on Dusek et al.’s (2016a) open source baseline model and context-aware neural language generator. Starting with the MR and NL pairs from the E2E generation challenge dataset, we explode the size of the training set using PERSONAGE (Mairesse and Walker, 2010), a statistical generator able to produce varied realizations from MRs, and use our expanded data as contextual input into our models. We present evaluation results using automated and human evaluation metrics, and describe directions for future work.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Data-to-Text Generation | E2E NLG Challenge | Sys1-Primary | BLEU | 65.61 | #7 of 11 | Archive leaderboard | report |
| Data-to-Text Generation | E2E NLG Challenge | Sys1-Primary | CIDEr | 2.2183 | #7 of 11 | Archive leaderboard | report |
| Data-to-Text Generation | E2E NLG Challenge | Sys1-Primary | METEOR | 45.17 | #7 of 11 | Archive leaderboard | report |
| Data-to-Text Generation | E2E NLG Challenge | Sys1-Primary | NIST | 8.5105 | #7 of 11 | Archive leaderboard | report |
| Data-to-Text Generation | E2E NLG Challenge | Sys1-Primary | ROUGE-L | 68.39 | #7 of 11 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections