{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/compressive-summarization-with-plausibility","title":"Compressive Summarization with Plausibility and Salience Modeling","arxiv_id":"2010.07886","date":"2020-10-15","proceeding":"EMNLP 2020 11","authors":["Shrey Desai","Jiacheng Xu","Greg Durrett"],"abstract":"Compressive summarization systems typically rely on a crafted set of syntactic rules to determine what spans of possible summary sentences can be deleted, then learn a model of what to actually delete by optimizing for content selection (ROUGE). In this work, we propose to relax the rigid syntactic constraints on candidate spans and instead leave compression decisions to two data-driven criteria: plausibility and salience. Deleting a span is plausible if removing it maintains the grammaticality and factuality of a sentence, and spans are salient if they contain important information from the summary. Each of these is judged by a pre-trained Transformer model, and only deletions that are both plausible and not salient can be applied. When integrated into a simple extraction-compression pipeline, our method achieves strong in-domain results on benchmark summarization datasets, and human evaluation shows that the plausibility model generally selects for grammatical and factual deletions. Furthermore, the flexibility of our approach allows it to generalize cross-domain: our system fine-tuned on only 500 samples from a new domain can match or exceed an in-domain extractive model trained on much more data.","url_abs":"https://arxiv.org/abs/2010.07886v1","url_pdf":"https://arxiv.org/pdf/2010.07886v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"compressive-summarization-with-plausibility","repo_url":"https://github.com/shreydesai/cups","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"sentence","task_name":"Sentence"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2010.07886","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.07886"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shreydesai/cups","reach":null}],"summary":{"ran_draft_wrong":12,"ran_honours":1,"ran_violates":2,"unverified":2},"by_repo_kind":{"official":{"samples":17,"ran":15,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"80c1196947e5845e","entry":"_adjective_phrases","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"80c1196947e5845e"}},{"code_sha256_prefix":"80ba6cf28c90f85e","entry":"_adverbial_phrases","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"80ba6cf28c90f85e"}},{"code_sha256_prefix":"01c44829b9b38957","entry":"_appositive_phrases","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"01c44829b9b38957"}},{"code_sha256_prefix":"8247f608b53cd636","entry":"_conjoined_noun_phrase","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8247f608b53cd636"}},{"code_sha256_prefix":"e045bd7f21e143f5","entry":"_conjoined_sentences","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e045bd7f21e143f5"}},{"code_sha256_prefix":"e068d8fa739eac70","entry":"_conjoined_verb_phrase","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e068d8fa739eac70"}},{"code_sha256_prefix":"bf501201ea8936ca","entry":"_fragment","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf501201ea8936ca"}},{"code_sha256_prefix":"4dd2bf46f071967d","entry":"_intro_prepositional_phrases","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4dd2bf46f071967d"}},{"code_sha256_prefix":"b8f51045d0ea77ee","entry":"_match_attribute","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b8f51045d0ea77ee"}},{"code_sha256_prefix":"3e22ac8c0d9478c1","entry":"_node_exists","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3e22ac8c0d9478c1"}},{"code_sha256_prefix":"5289c0cd9f5707fc","entry":"_optional","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5289c0cd9f5707fc"}},{"code_sha256_prefix":"2596c4755c8365fc","entry":"_parenthetical","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2596c4755c8365fc"}},{"code_sha256_prefix":"0627e42c79621338","entry":"_prepositional_phrases","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0627e42c79621338"}},{"code_sha256_prefix":"7768dbb5a5eafdb2","entry":"_relative_clause","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7768dbb5a5eafdb2"}},{"code_sha256_prefix":"645daed1be62efb4","entry":"_sentence","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"645daed1be62efb4"}},{"code_sha256_prefix":"1f524ece920d1a27","entry":"_group","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1f524ece920d1a27"}},{"code_sha256_prefix":"48c53eac31cbd41e","entry":"find_compressions","repo":"shreydesai/cups","repo_kind":"official","path":"compression_utils.py","file_url":"https://github.com/shreydesai/cups/blob/HEAD/compression_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"48c53eac31cbd41e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}