Papers › Semantic Component Analysis: Discovering Patterns in Short Texts Beyond Topics

Semantic Component Analysis: Discovering Patterns in Short Texts Beyond Topics

28 Oct 2024arXiv:2410.21054archive 2025-07-28

Florian Eichin, Carolin M. Schuster, Georg Groh, Michael A. Hedderich

Topic modeling is a key method in text analysis, but existing approaches are limited by assuming one topic per document or fail to scale efficiently for large, noisy datasets of short texts. We introduce Semantic Component Analysis (SCA), a novel topic modeling technique that overcomes these limitations by discovering multiple, nuanced semantic components beyond a single topic in short texts which we accomplish by introducing a decomposition step to the clustering-based topic modeling framework. We evaluate SCA on Twitter datasets in English, Hausa and Chinese. It achieves competetive coherence and diversity compared to BERTopic, while uncovering at least double the semantic components and maintaining a noise rate close to zero. Furthermore, SCA is scalable and effective across languages, including an underrepresented one.

PaperPDFCode

Code

mainlp/semantic_components officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Diversity

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

SCA

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections