Papers › Lbl2Vec: An Embedding-Based Approach for Unsupervised Document Retrieval on Predefined Topics

Lbl2Vec: An Embedding-Based Approach for Unsupervised Document Retrieval on Predefined Topics

12 Oct 2022arXiv:2210.06023archive 2025-07-28

Tim Schopf, Daniel Braun, Florian Matthes

In this paper, we consider the task of retrieving documents with predefined topics from an unlabeled document dataset using an unsupervised approach. The proposed unsupervised approach requires only a small number of keywords describing the respective topics and no labeled document. Existing approaches either heavily relied on a large amount of additionally encoded world knowledge or on term-document frequencies. Contrariwise, we introduce a method that learns jointly embedded document and word vectors solely from the unlabeled document dataset in order to find documents that are semantically similar to the topics described by the keywords. The proposed method requires almost no text preprocessing but is simultaneously effective at retrieving relevant documents with high probability. When successively retrieving documents on different predefined topics from publicly available and commonly used datasets, we achieved an average area under the receiver operating characteristic curve value of 0.95 on one dataset and 0.92 on another. Further, our method can be used for multiclass document classification, without the need to assign labels to the dataset in advance. Compared with an unsupervised classification baseline, we increased F1 scores from 76.6 to 82.7 and from 61.0 to 75.1 on the respective datasets. For easy replication of our approach, we make the developed Lbl2Vec code publicly available as a ready-to-use tool under the 3-Clause BSD license.

PaperPDFCode

Code

sebischair/lbl2vec officialmentioned in papermentioned on GitHubBSD-3-Clause report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Document ClassificationRetrievalUnsupervised Text ClassificationWorld Knowledge

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Text Classification 20NewsGroups Lbl2Vec F1-score 75.1 #1 of 2 Archive leaderboard report
Unsupervised Text Classification AG News Lbl2Vec F1 score 82.7 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Lbl2Vec

Lbl2Vec

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections