Papers › BART-IT: An Efficient Sequence-to-Sequence Model for Italian Text Summarization

BART-IT: An Efficient Sequence-to-Sequence Model for Italian Text Summarization

27 Dec 2022Future Internet 2022 12archive 2025-07-28

La Quatra Moreno, Cagliero Luca

The emergence of attention-based architectures has led to significant improvements in the performance of neural sequence-to-sequence models for text summarization. Although these models have proved to be effective in summarizing English-written documents, their portability to other languages is limited thus leaving plenty of room for improvement. In this paper, we present BART-IT, a sequence-to-sequence model, based on the BART architecture that is specifically tailored to the Italian language. The model is pre-trained on a large corpus of Italian-written pieces of text to learn language-specific features and then fine-tuned on several benchmark datasets established for abstractive summarization. The experimental results show that BART-IT outperforms other state-of-the-art models in terms of ROUGE scores in spite of a significantly smaller number of parameters. The use of BART-IT can foster the development of interesting NLP applications for the Italian language. Beyond releasing the model to the research community to foster further research and applications, we also discuss the ethical implications behind the use of abstractive summarization models.

PaperPDFCode

Code

MorenoLaQuatra/bart-it mentioned in paperpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Abstractive Text SummarizationText Summarization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mBART # Parameters 610 #1 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mBART BERTScore 73.4 #1 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mBART ROUGE-1 36.52 #1 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mBART ROUGE-2 17.52 #1 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mBART ROUGE-L 26.14 #1 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage BART-IT # Parameters 140 #3 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage BART-IT BERTScore 73.24 #3 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage BART-IT ROUGE-1 35.42 #3 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage BART-IT ROUGE-2 15.88 #3 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage BART-IT ROUGE-L 25.12 #3 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mT5 # Parameters 390 #4 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mT5 BERTScore 72.77 #4 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mT5 ROUGE-1 34.13 #4 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mT5 ROUGE-2 15.76 #4 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage mT5 ROUGE-L 24.84 #4 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage IT5-base # Parameters 220 #5 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage IT5-base BERTScore 70.3 #5 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage IT5-base ROUGE-1 33.99 #5 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage IT5-base ROUGE-2 15.59 #5 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Fanpage IT5-base ROUGE-L 24.91 #5 of 6 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mBART BERTScore 75.86 #1 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mBART ROUGE-1 38.91 #1 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mBART ROUGE-2 21.41 #1 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mBART ROUGE-L 32.08 #1 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post BART-IT BERTScore 75.36 #3 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post BART-IT ROUGE-1 37.31 #3 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post BART-IT ROUGE-2 19.44 #3 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post BART-IT ROUGE-L 30.41 #3 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mT5 BERTScore 74.69 #4 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mT5 ROUGE-1 35.04 #4 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mT5 ROUGE-2 17.41 #4 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post mT5 ROUGE-L 28.68 #4 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post IT5-base BERTScore 71.06 #6 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post IT5-base ROUGE-1 32.88 #6 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post IT5-base ROUGE-2 15.53 #6 of 8 Archive leaderboard report
Abstractive Text Summarization Abstractive Text Summarization from Il Post IT5-base ROUGE-L 26.7 #6 of 8 Archive leaderboard report
Abstractive Text Summarization WITS BART-IT BERTScore 79.28 #1 of 4 Archive leaderboard report
Abstractive Text Summarization WITS BART-IT ROUGE-1 42.32 #1 of 4 Archive leaderboard report
Abstractive Text Summarization WITS BART-IT ROUGE-2 28.83 #1 of 4 Archive leaderboard report
Abstractive Text Summarization WITS BART-IT ROUGE-L 38.84 #1 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mT5 BERTScore 80.73 #2 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mT5 ROUGE-1 40.6 #2 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mT5 ROUGE-2 26.9 #2 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mT5 ROUGE-L 37.43 #2 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mBART BERTScore 78.65 #3 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mBART ROUGE-1 39.32 #3 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mBART ROUGE-2 26.18 #3 of 4 Archive leaderboard report
Abstractive Text Summarization WITS mBART ROUGE-L 35.9 #3 of 4 Archive leaderboard report
Abstractive Text Summarization WITS IT5-base BERTScore 77.14 #4 of 4 Archive leaderboard report
Abstractive Text Summarization WITS IT5-base ROUGE-1 37.98 #4 of 4 Archive leaderboard report
Abstractive Text Summarization WITS IT5-base ROUGE-2 24.32 #4 of 4 Archive leaderboard report
Abstractive Text Summarization WITS IT5-base ROUGE-L 34.94 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AdamAttentionBARTBPEDense ConnectionsDropoutLayer NormalizationLinear LayerMulti-Head AttentionResidual ConnectionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections