Papers › Leveraging BERT for Extractive Text Summarization on Lectures

Leveraging BERT for Extractive Text Summarization on Lectures

7 Jun 2019arXiv:1906.04165archive 2025-07-28

Derek Miller

In the last two decades, automatic extractive text summarization on lectures has demonstrated to be a useful tool for collecting key phrases and sentences that best represent the content. However, many current approaches utilize dated approaches, producing sub-par outputs or requiring several hours of manual tuning to produce meaningful results. Recently, new machine learning architectures have provided mechanisms for extractive summarization through the clustering of output embeddings from deep learning models. This paper reports on the project called Lecture Summarization Service, a python based RESTful service that utilizes the BERT model for text embeddings and KMeans clustering to identify sentences closes to the centroid for summary selection. The purpose of the service was to provide students a utility that could summarize lecture content, based on their desired number of sentences. On top of the summary work, the service also includes lecture and summary management, storing content on the cloud which can be used for collaboration. While the results of utilizing BERT for extractive summarization were promising, there were still areas where the model struggled, providing feature research opportunities for further improvement.

Paper PDF Code

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

dmmiller612/lecture-summarizer officialmentioned in papermentioned on GitHub report

chalothon/lecture_extractive_sum mentioned on GitHub report

dmmiller612/bert-extractive-summarizer mentioned on GitHubpytorchMIT report

gradjitta/bertsum-streamlit mentioned on GitHubpytorch report

kurodenjiro/bert-extractive-summarizer-vietnamese mentioned on GitHubpytorchMIT report

kylehiroyasu/bert-extractive-summarizer mentioned on GitHubpytorchMIT report

saranthn/FYP-Bert mentioned on GitHub report

shivampanjeta/bert-extractive-summarizer mentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Clustering Extractive Summarization Extractive Text Summarization Management Text Summarization

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Adam Attention Attention Dropout BERT Dense Connections Dropout Layer Normalization Linear Layer Linear Warmup With Linear Decay Multi-Head Attention Residual Connection Softmax Weight Decay WordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections