Papers › Clustering-friendly Representation Learning via Instance Discrimination and Feature...

Clustering-friendly Representation Learning via Instance Discrimination and Feature Decorrelation

31 May 2021ICLR 2021 1arXiv:2106.00131archive 2025-07-28

Yaling Tao, Kentaro Takagi, Kouta Nakata

Clustering is one of the most fundamental tasks in machine learning. Recently, deep clustering has become a major trend in clustering techniques. Representation learning often plays an important role in the effectiveness of deep clustering, and thus can be a principal cause of performance degradation. In this paper, we propose a clustering-friendly representation learning method using instance discrimination and feature decorrelation. Our deep-learning-based representation learning method is motivated by the properties of classical spectral clustering. Instance discrimination learns similarities among data and feature decorrelation removes redundant correlation among features. We utilize an instance discrimination method in which learning individual instance classes leads to learning similarity among instances. Through detailed experiments and examination, we show that the approach can be adapted to learning a latent space for clustering. We design novel softmax-formulated decorrelation constraints for learning. In evaluations of image clustering using CIFAR-10 and ImageNet-10, our method achieves accuracy of 81.5% and 95.4%, respectively. We also show that the softmax-formulated constraints are compatible with various neural networks.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

TTN-YKK/Clustering_friendly_representation_learning officialmentioned in paperpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClusteringDeep ClusteringImage ClusteringRepresentation Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Clustering CIFAR-10 IDFD ARI 0.663 #27 of 40 Archive leaderboard report
Image Clustering CIFAR-10 IDFD Accuracy 0.815 #27 of 40 Archive leaderboard report
Image Clustering CIFAR-10 IDFD Backbone ResNet-18 #27 of 40 Archive leaderboard report
Image Clustering CIFAR-10 IDFD NMI 0.711 #27 of 40 Archive leaderboard report
Image Clustering CIFAR-10 IDFD Train set Train+Test #27 of 40 Archive leaderboard report
Image Clustering CIFAR-100 IDFD ARI 0.264 #21 of 30 Archive leaderboard report
Image Clustering CIFAR-100 IDFD Accuracy 0.425 #21 of 30 Archive leaderboard report
Image Clustering CIFAR-100 IDFD NMI 0.426 #21 of 30 Archive leaderboard report
Image Clustering CIFAR-100 IDFD Train Set Train #21 of 30 Archive leaderboard report
Image Clustering ImageNet-10 IDFD ARI 0.901 #8 of 18 Archive leaderboard report
Image Clustering ImageNet-10 IDFD Accuracy 0.954 #8 of 18 Archive leaderboard report
Image Clustering ImageNet-10 IDFD Image Size 96 #8 of 18 Archive leaderboard report
Image Clustering ImageNet-10 IDFD NMI 0.898 #8 of 18 Archive leaderboard report
Image Clustering Imagenet-dog-15 IDFD ARI 0.413 #10 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 IDFD Accuracy 0.591 #10 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 IDFD Image Size 96 #10 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 IDFD NMI 0.546 #10 of 20 Archive leaderboard report
Image Clustering STL-10 IDFD Accuracy 0.756 #17 of 29 Archive leaderboard report
Image Clustering STL-10 IDFD Backbone ResNet-18 #17 of 29 Archive leaderboard report
Image Clustering STL-10 IDFD NMI 0.643 #17 of 29 Archive leaderboard report
Image Clustering STL-10 IDFD Train Split Train+Test #17 of 29 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections