Papers › Choosing the Number of Topics in LDA Models -- A Monte Carlo Comparison of Selection Criteria

Choosing the Number of Topics in LDA Models -- A Monte Carlo Comparison of Selection Criteria

28 Dec 2022arXiv:2212.14074archive 2025-07-28

Victor Bystrov, Viktoriia Naboka, Anna Staszewska-Bystrova, Peter Winker

Selecting the number of topics in LDA models is considered to be a difficult task, for which alternative approaches have been proposed. The performance of the recently developed singular Bayesian information criterion (sBIC) is evaluated and compared to the performance of alternative model selection criteria. The sBIC is a generalization of the standard BIC that can be implemented to singular statistical models. The comparison is based on Monte Carlo simulations and carried out for several alternative settings, varying with respect to the number of topics, the number of documents and the size of documents in the corpora. Performance is measured using different criteria which take into account the correct number of topics, but also whether the relevant topics from the DGPs are identified. Practical recommendations for LDA model selection in applications are derived.

PaperPDFCode

Code

vikana/sbic officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Model Selection

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

LDA

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections