Papers › Improving Neural Abstractive Document Summarization with Structural Regularization

Improving Neural Abstractive Document Summarization with Structural Regularization

1 Oct 2018EMNLP 2018 10archive 2025-07-28

Wei Li, Xinyan Xiao, Yajuan Lyu, Yuanzhuo Wang

Recent neural sequence-to-sequence models have shown significant progress on short text summarization. However, for document summarization, they fail to capture the long-term structure of both documents and multi-sentence summaries, resulting in information loss and repetitions. In this paper, we propose to leverage the structural information of both documents and multi-sentence summaries to improve the document summarization performance. Specifically, we import both structural-compression and structural-coverage regularization into the summarization process in order to capture the information compression and information coverage properties, which are the two most important structural properties of document summarization. Experimental results demonstrate that the structural regularization improves the document summarization performance significantly, which enables our model to generate more informative and concise summaries, and thus significantly outperforms state-of-the-art neural abstractive methods.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Abstractive Text SummarizationDocument SummarizationMachine TranslationSentenceSentence SummarizationText GenerationText Summarization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Abstractive Text Summarization CNN / Daily Mail Li et al. ROUGE-1 40.30 #43 of 53 Archive leaderboard report
Abstractive Text Summarization CNN / Daily Mail Li et al. ROUGE-2 18.02 #43 of 53 Archive leaderboard report
Abstractive Text Summarization CNN / Daily Mail Li et al. ROUGE-L 37.36 #43 of 53 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections