{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multi-document-summarization","title":"Multi-Document Summarization withDeterminantal Point Process Attention","arxiv_id":null,"date":"2021-07-13","proceeding":"Journal of Artificial Intelligence Research 2021 7","authors":["Laura Perez-Beltrachini","Mirella Lapata"],"abstract":"The  ability  to  convey  relevant  and  diverse  information  is  critical  in  multi-documentsummarization and yet remains elusive for neural seq-to-seq models whose outputs are of-ten redundant and fail to correctly cover important details.  In this work, we propose anattention mechanism which encourages greater focus onrelevanceanddiversity.  Attentionweights are computed based on (proportional) probabilities given by Determinantal PointProcesses (DPPs) defined on the set of content units to be summarized.  DPPs have beensuccessfully  used  in  extractive  summarisation,  here  we  use  them  to  select  relevant  anddiverse content for neural abstractive summarisation.  We integrate DPP-based attentionwith  various  seq-to-seq  architectures  ranging  from  CNNs  to  LSTMs,  and  Transformers.Experimental evaluation shows that our attention mechanism consistently improves sum-marization and delivers performance comparable with the state-of-the-art on the MultiNewsdataset.","url_abs":"https://www.jair.org/index.php/jair/article/view/12522/26693","url_pdf":"https://www.jair.org/index.php/jair/article/view/12522/26693","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"document-summarization","task_name":"Document Summarization"},{"task_slug":"multi-document-summarization","task_name":"Multi-Document Summarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/multi-document-summarization-on-multi-news","task":"Multi-Document Summarization","dataset":"Multi-News","model":"CTF+DPP","rank_in_archive_order":3,"of":6,"metrics":{"ROUGE-1":"45.84","ROUGE-2":"15.94","ROUGE-SU4":"19.19"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}