Papers › Self-Supervised Classification Network

Self-Supervised Classification Network

19 Mar 2021arXiv:2103.10994archive 2025-07-28

Elad Amrani, Leonid Karlinsky, Alex Bronstein

We present Self-Classifier -- a novel self-supervised end-to-end classification learning approach. Self-Classifier learns labels and representations simultaneously in a single-stage end-to-end manner by optimizing for same-class prediction of two augmented views of the same sample. To guarantee non-degenerate solutions (i.e., solutions where all labels are assigned to the same class) we propose a mathematically motivated variant of the cross-entropy loss that has a uniform prior asserted on the predicted labels. In our theoretical analysis, we prove that degenerate solutions are not in the set of optimal solutions of our approach. Self-Classifier is simple to implement and scalable. Unlike other popular unsupervised classification and contrastive representation learning approaches, it does not require any form of pre-training, expectation-maximization, pseudo-labeling, external clustering, a second network, stop-gradient operation, or negative pairs. Despite its simplicity, our approach sets a new state of the art for unsupervised classification of ImageNet; and even achieves comparable to state-of-the-art results for unsupervised representation learning. Code is available at https://github.com/elad-amrani/self-classifier.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

elad-amrani/self-classifier officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClassificationClusteringContrastive LearningGeneral ClassificationRepresentation LearningSelf-Supervised Image ClassificationUnsupervised Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Self-Supervised Image Classification ImageNet Self-Classifier (ResNet-50) Number of Params 24M #87 of 144 Archive leaderboard report
Self-Supervised Image Classification ImageNet Self-Classifier (ResNet-50) Top 1 Accuracy 74.2% #87 of 144 Archive leaderboard report
Unsupervised Image Classification ImageNet Self-Classifier (ResNet-50) ARI 29.5 #5 of 9 Archive leaderboard report
Unsupervised Image Classification ImageNet Self-Classifier (ResNet-50) Accuracy (%) 41.1 #5 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections