Browse State-of-the-Art › Text Summarization
Text Summarization
440 papers with code · 37 benchmarks · 98 datasets archive 2025-07-28
Text Summarization is a natural language processing (NLP) task that involves condensing a lengthy text document into a shorter, more compact version while still retaining the most important information and meaning. The goal is to produce a summary that accurately represents the content of the original text in a concise form.
There are different approaches to text summarization, including extractive methods that identify and extract important sentences or phrases from the text, and abstractive methods that generate new text based on the content of the original text.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
37 leaderboard tables shown for this task, 37 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 37 until expanded.
Syntology 8 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): X-Sum (4 judged, 0 placed), GovReport (3 judged, 0 placed), MeetingBank (1 judged, 0 placed), XSum (3 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
98 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 98 until expanded.
Subtasks archive 2025-07-28
12 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 1,340 · with a code link: 440 · where Syntology ran a sample: 84 (69 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (84 of 1,340 tagged: 69 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument)
Page 1 of 14: papers 1 to 100 of 1,340, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Jun 2017 595 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified (of 946 harvested samples) · 451 pointer-only (licence)The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
-
29 Oct 2019 47 repositories listed Syntology 40 ran (of which 7 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 2 violated, 27 with no contract checked; 10 where Syntology's instrument failed) · 13 unverified (of 53 harvested samples) · 13 pointer-only (licence)We evaluate a number of noising approaches, finding the best performance by both randomly shuffling the order of the original sentences and using a novel in-filling scheme, where spans of text are replaced with a single…
-
14 Apr 2017 39 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 30 ran (of which 11 constructed an object rather than computing a result; 25 with no instrument failure: 4 honoured, 2 violated, 19 with no contract checked; 5 where Syntology's instrument failed) · 34 unverified (of 64 harvested samples) · 44 pointer-only (licence)Neural sequence-to-sequence models have provided a viable new approach for abstractive text summarization (meaning they are not restricted to simply selecting and rearranging passages from the original text).
-
18 Dec 2019 19 repositories listed Syntology official (archive's flag): 7 ran · 16 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 19 harvested samples)Recent work pre-training Transformers with self-supervised objectives on large text corpora has shown great success when fine-tuned on downstream NLP tasks including text summarization.
-
22 Aug 2019 19 repositories listed Syntology community repositories only · 13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 21 harvested samples) · 5 pointer-only (licence)For abstractive summarization, we propose a new fine-tuning schedule which adopts different optimizers for the encoder and the decoder as a means of alleviating the mismatch between the two (the former is pretrained…
-
28 Jul 2020 14 repositories listed Syntology official (archive's flag): 1 ran · 10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 11 pointer-only (licence)To remedy this, we propose, BigBird, a sparse attention mechanism that reduces this quadratic dependency to linear.
-
20 Aug 2021 13 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)In this way, Fastformer can achieve effective context modeling with linear complexity.
-
11 May 2017 10 repositories listedWe introduce a neural network model with a novel intra-attention that attends over the input and continuously generated output separately, and a new training method that combines standard supervised word prediction and…
-
8 May 2019 9 repositories listedThis paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks.
-
18 Oct 2018 9 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Sequence-to-sequence models have recently gained the state of the art performance in summarization.
-
7 Jun 2019 8 repositories listedThis paper reports on the project called Lecture Summarization Service, a python based RESTful service that utilizes the BERT model for text embeddings and KMeans clustering to identify sentences closes to the centroid…
-
15 May 2023 7 repositories listedOur proposed framework provides access: (i) for verifying whether automatic metrics are faithful to human preference, regardless of their correlation level to human; and (ii) for inspecting the strengths and limitations…
-
29 Jul 2019 7 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)Unsupervised pre-training of large neural models has recently revolutionized Natural Language Processing.
-
7 May 2019 7 repositories listedPre-training and fine-tuning, e. g., BERT, have achieved great success in language understanding by transferring knowledge from rich-resource pre-training task to the low/zero-resource downstream tasks.
-
14 Nov 2016 7 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We present SummaRuNNer, a Recurrent Neural Network (RNN) based sequence model for extractive summarization of documents and show that it achieves performance better than or comparable to state-of-the-art.
-
21 Mar 2016 7 repositories listedCopyNet can nicely integrate the regular way of word generation in the decoder with the new copying mechanism which can choose sub-sequences in the input sequence and put them at proper places in the output sequence.
-
24 Jul 2020 6 repositories listed Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress.
-
13 Oct 2022 5 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)MTEB spans 8 embedding tasks covering a total of 58 datasets and 112 languages.
-
26 Apr 2021 5 repositories listedTo enhance the generalization ability of PanGu-α, we collect 1.
-
23 Oct 2020 5 repositories listedWe show BARThez to be very competitive with state-of-the-art BERT-based French language models such as CamemBERT and FlauBERT.
-
26 Jan 2020 5 repositories listedCurrent pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks.
-
13 Jan 2020 5 repositories listedThis paper presents a new sequence-to-sequence pre-training model called ProphetNet, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism.
-
5 Dec 2018 5 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)As part of this survey, we also develop an open source library, namely, Neural Abstractive Text Summarizer (NATS) toolkit, for the abstractive text summarization.
-
21 Sep 2023 4 repositories listed Syntology official (archive's flag): 9 ran · 11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 1 pointer-only (licence)For example, training on the context length of 8192 needs 16x computational costs in self-attention layers as that of 2048.
-
7 Feb 2022 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)In this work, we pursue a unified paradigm for multimodal pretraining to break the scaffolds of complex task/modality-specific customization.
-
15 Dec 2021 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models.
-
28 Oct 2019 4 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Currently used metrics for assessing summarization algorithms do not account for whether summaries are factually consistent with source documents.
-
25 Feb 2019 4 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)For the decoder, there are two stages in our model, in the first stage, we use a Transformer-based decoder to generate a draft output sequence.
-
2 Sep 2015 4 repositories listedSummarization based on text extraction is inherently limited, but generation-style abstractive methods have proven challenging to build.
-
22 Apr 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 9 pointer-only (licence)The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream…
-
28 Nov 2023 3 repositories listed
-
29 Aug 2023 3 repositories listed
-
29 Mar 2023 3 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
31 Mar 2022 3 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
16 Oct 2021 3 repositories listed Syntology official (archive's flag): 4 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
20 Sep 2021 3 repositories listed
-
22 Jun 2021 3 repositories listed
-
16 Apr 2021 3 repositories listed
-
14 Nov 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
6 Aug 2020 3 repositories listed
-
4 Apr 2020 3 repositories listed
-
15 Nov 2019 3 repositories listed
-
27 May 2019 3 repositories listed
-
27 Aug 2018 3 repositories listed Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
28 May 2018 3 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
24 May 2018 3 repositories listed Syntology official (archive's flag): 12 ran · 16 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 2 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 17 harvested samples) · 2 pointer-only (licence)
-
24 Apr 2018 3 repositories listed
-
16 Apr 2018 3 repositories listed Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples)
-
22 May 2017 3 repositories listed
-
22 Dec 2024 2 repositories listed
-
7 Oct 2024 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
1 Jul 2024 2 repositories listed
-
20 Feb 2024 2 repositories listed Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 3 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 7 pointer-only (licence)
-
18 Feb 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
17 Nov 2023 2 repositories listed
-
16 Jun 2023 2 repositories listed Syntology community repositories only · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
13 Jun 2023 2 repositories listed
-
7 Jun 2023 2 repositories listed
-
1 Jun 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 8 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 6 where Syntology's instrument failed) · 10 unverified (of 18 harvested samples) · 4 pointer-only (licence)
-
24 May 2023 2 repositories listed
-
16 May 2023 2 repositories listed
-
26 Jan 2023 2 repositories listed
-
22 Nov 2022 2 repositories listed
-
20 Nov 2022 2 repositories listed
-
13 Oct 2022 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
8 Aug 2022 2 repositories listed
-
6 Jun 2022 2 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
29 May 2022 2 repositories listed
-
1 May 2022 2 repositories listed
-
29 Jan 2022 2 repositories listed
-
18 Jan 2022 2 repositories listed
-
16 Nov 2021 2 repositories listed
-
16 Oct 2021 2 repositories listed
-
15 Oct 2021 2 repositories listed
-
27 Aug 2021 2 repositories listed
-
26 Aug 2021 2 repositories listed
-
25 Jun 2021 2 repositories listed
-
25 Jun 2021 2 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
3 Jun 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
18 May 2021 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
15 Apr 2021 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
31 Jan 2021 2 repositories listed
-
26 Jan 2021 2 repositories listed
-
22 Dec 2020 2 repositories listed
-
7 Dec 2020 2 repositories listed
-
5 Nov 2020 2 repositories listed
-
11 Oct 2020 2 repositories listed
-
21 Aug 2020 2 repositories listed
-
15 Jul 2020 2 repositories listed
-
9 Jul 2020 2 repositories listed
-
19 Jun 2020 2 repositories listed
-
27 Apr 2020 2 repositories listed
-
19 Apr 2020 2 repositories listed
-
14 Apr 2020 2 repositories listed
-
23 Nov 2019 2 repositories listed
-
10 Nov 2019 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
2 Oct 2019 2 repositories listed
-
1 Oct 2019 2 repositories listed
-
8 Jul 2019 2 repositories listed
Syntology lines on 40 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections