Papers › Learning Representation for Clustering via Prototype Scattering and Positive Sampling

Learning Representation for Clustering via Prototype Scattering and Positive Sampling

23 Nov 2021arXiv:2111.11821archive 2025-07-28

Zhizhong Huang, Jie Chen, Junping Zhang, Hongming Shan

Existing deep clustering methods rely on either contrastive or non-contrastive representation learning for downstream clustering task. Contrastive-based methods thanks to negative pairs learn uniform representations for clustering, in which negative pairs, however, may inevitably lead to the class collision issue and consequently compromise the clustering performance. Non-contrastive-based methods, on the other hand, avoid class collision issue, but the resulting non-uniform representations may cause the collapse of clustering. To enjoy the strengths of both worlds, this paper presents a novel end-to-end deep clustering method with prototype scattering and positive sampling, termed ProPos. Specifically, we first maximize the distance between prototypical representations, named prototype scattering loss, which improves the uniformity of representations. Second, we align one augmented view of instance with the sampled neighbors of another view -- assumed to be truly positive pair in the embedding space -- to improve the within-cluster compactness, termed positive sampling alignment. The strengths of ProPos are avoidable class collision issue, uniform representations, well-separated clusters, and within-cluster compactness. By optimizing ProPos in an end-to-end expectation-maximization framework, extensive experimental results demonstrate that ProPos achieves competing performance on moderate-scale clustering benchmark datasets and establishes new state-of-the-art performance on large-scale datasets. Source code is available at \url{https://github.com/Hzzone/ProPos}.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

hzzone/propos officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClusteringContrastive LearningDeep ClusteringImage ClusteringRepresentation Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Clustering ImageNet-10 ProPos* ARI 0.918 #4 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos* Accuracy 0.962 #4 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos* Backbone ResNet-34 #4 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos* Image Size 224 #4 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos* NMI 0.908 #4 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos ARI 0.906 #9 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos Accuracy 0.956 #9 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos Backbone ResNet-34 #9 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos Image Size 96 #9 of 18 Archive leaderboard report
Image Clustering ImageNet-10 ProPos NMI 0.896 #9 of 18 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos* ARI 0.675 #4 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos* Accuracy 0.775 #4 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos* Backbone ResNet-34 #4 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos* Image Size 224 #4 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos* NMI 0.737 #4 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos ARI 0.627 #5 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos Accuracy 0.745 #5 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos Backbone ResNet-34 #5 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos Image Size 96 #5 of 20 Archive leaderboard report
Image Clustering Imagenet-dog-15 ProPos NMI 0.692 #5 of 20 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

BYOLContrastive Learning

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections