Papers › Learn to Copy from the Copying History: Correlational Copy Network for Abstractive...
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization
Haoran Li, Song Xu, Peng Yuan, Yujia Wang, Youzheng Wu, Xiaodong He, BoWen Zhou
The copying mechanism has had considerable success in abstractive summarization, facilitating models to directly copy words from the input text to the output summary. Existing works mostly employ encoder-decoder attention, which applies copying at each time step independently of the former ones. However, this may sometimes lead to incomplete copying. In this paper, we propose a novel copying scheme named Correlational Copying Network (CoCoNet) that enhances the standard copying mechanism by keeping track of the copying history. It thereby takes advantage of prior copying distributions and, at each time step, explicitly encourages the model to copy the input word that is relevant to the previously copied one. In addition, we strengthen CoCoNet through pre-training with suitable corpora that simulate the copying behaviors. Experimental results show that CoCoNet can copy more accurately and achieves new state-of-the-art performances on summarization benchmarks, including CNN/DailyMail for news summarization and SAMSum for dialogue summarization. The code and checkpoint will be publicly available.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet + CoCoPretrain | ROUGE-1 | 44.50 | #11 of 53 | Archive leaderboard | report |
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet + CoCoPretrain | ROUGE-2 | 21.55 | #11 of 53 | Archive leaderboard | report |
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet + CoCoPretrain | ROUGE-L | 41.24 | #11 of 53 | Archive leaderboard | report |
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet | ROUGE-1 | 44.39 | #13 of 53 | Archive leaderboard | report |
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet | ROUGE-2 | 21.41 | #13 of 53 | Archive leaderboard | report |
| Abstractive Text Summarization | CNN / Daily Mail | CoCoNet | ROUGE-L | 41.05 | #13 of 53 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections