Papers › Ensure the Correctness of the Summary: Incorporate Entailment Knowledge into...

Ensure the Correctness of the Summary: Incorporate Entailment Knowledge into Abstractive Sentence Summarization

1 Aug 2018COLING 2018 8archive 2025-07-28

Haoran Li, Junnan Zhu, Jiajun Zhang, Cheng-qing Zong

In this paper, we investigate the sentence summarization task that produces a summary from a source sentence. Neural sequence-to-sequence models have gained considerable success for this task, while most existing approaches only focus on improving the informativeness of the summary, which ignore the correctness, i.e., the summary should not contain unrelated information with respect to the source sentence. We argue that correctness is an essential requirement for summarization systems. Considering a correct summary is semantically entailed by the source sentence, we incorporate entailment knowledge into abstractive summarization models. We propose an entailment-aware encoder under multi-task framework (i.e., summarization generation and entailment recognition) and an entailment-aware decoder by entailment Reward Augmented Maximum Likelihood (RAML) training. Experiment results demonstrate that our models significantly outperform baselines from the aspects of informativeness and correctness.

PaperPDFConference PDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Abstractive Text SummarizationDecoderInformativenessSentenceSentence SummarizationSummarizationText Summarization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Text Summarization DUC 2004 Task 1 Seq2seq + selective + MTL + ERAM ROUGE-1 29.33 #7 of 13 Archive leaderboard report
Text Summarization DUC 2004 Task 1 Seq2seq + selective + MTL + ERAM ROUGE-2 10.24 #7 of 13 Archive leaderboard report
Text Summarization DUC 2004 Task 1 Seq2seq + selective + MTL + ERAM ROUGE-L 25.24 #7 of 13 Archive leaderboard report
Text Summarization GigaWord Seq2seq + selective + MTL + ERAM ROUGE-1 35.33 #37 of 41 Archive leaderboard report
Text Summarization GigaWord Seq2seq + selective + MTL + ERAM ROUGE-2 17.27 #37 of 41 Archive leaderboard report
Text Summarization GigaWord Seq2seq + selective + MTL + ERAM ROUGE-L 33.19 #37 of 41 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections