Papers › TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts

TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts

4 Oct 2021EMNLP (newsum) 2021 11arXiv:2110.01159archive 2025-07-28

Sajad Sotudeh, Hanieh Deilamsalehy, Franck Dernoncourt, Nazli Goharian

Recent models in developing summarization systems consist of millions of parameters and the model performance is highly dependent on the abundance of training data. While most existing summarization corpora contain data in the order of thousands to one million, generation of large-scale summarization datasets in order of couple of millions is yet to be explored. Practically, more data is better at generalizing the training patterns to unseen data. In this paper, we introduce TLDR9+ -- a large-scale summarization dataset -- containing over 9 million training instances extracted from Reddit discussion forum (https://github.com/sajastu/reddit_collector). This dataset is specifically gathered to perform extreme summarization (i.e., generating one-sentence summary in high compression and abstraction) and is more than twice larger than the previously proposed dataset. We go one step further and with the help of human annotations, we distill a more fine-grained dataset by sampling High-Quality instances from TLDR9+ and call it TLDRHQ dataset. We further pinpoint different state-of-the-art summarization models on our proposed datasets.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

sajastu/reddit_collector officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Extreme SummarizationSentence

Datasets

Introduced by this paper, per the archive.

TLDR9+

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Extreme Summarization TLDR9+ ORACLE-EXT RG-1(%) 30.26 #1 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ ORACLE-EXT RG-2(%) 9.74 #1 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ ORACLE-EXT RG-L(%) 20.60 #1 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BART RG-1(%) 23.59 #2 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BART RG-2(%) 9.69 #2 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BART RG-L(%) 18.62 #2 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMABS RG-1(%) 23.05 #3 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMABS RG-2(%) 9.48 #3 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMABS RG-L(%) 18.07 #3 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMEXT RG-1(%) 20.94 #4 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMEXT RG-2(%) 4.98 #4 of 4 Archive leaderboard report
Extreme Summarization TLDR9+ BERTSUMEXT RG-L(%) 14.48 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections