Papers › Benchmarking Self-Supervised Learning on Diverse Pathology Datasets

Benchmarking Self-Supervised Learning on Diverse Pathology Datasets

9 Dec 2022CVPR 2023 1arXiv:2212.04690archive 2025-07-28

Mingu Kang, Heon Song, Seonwook Park, Donggeun Yoo, Sérgio Pereira

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data, and its application to pathology could greatly benefit its downstream tasks. Yet, there are no principled studies that compare SSL methods and discuss how to adapt them for pathology. To address this need, we execute the largest-scale study of SSL pre-training on pathology image data, to date. Our study is conducted using 4 representative SSL methods on diverse downstream tasks. We establish that large-scale domain-aligned pre-training in pathology consistently out-performs ImageNet pre-training in standard SSL settings such as linear and fine-tuning evaluations, as well as in low-label regimes. Moreover, we propose a set of domain-specific techniques that we experimentally show leads to a performance boost. Lastly, for the first time, we apply SSL to the challenging task of nuclei instance segmentation and show large and consistent performance improvements under diverse settings.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

kaiko-ai/eva mentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BenchmarkingClassificationInstance SegmentationSelf-Supervised LearningSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Classification MHIST MoCo-v2 (ResNet-50) Accuracy 85.88 #2 of 9 Archive leaderboard report
Classification MHIST Supervised (ViT-S/16) Accuracy 81.68 #5 of 9 Archive leaderboard report
Classification MHIST Barlow Rwins (ResNet-50) Accuracy 81.27 #6 of 9 Archive leaderboard report
Classification MHIST DINO (ViT-S/16) Accuracy 79.43 #7 of 9 Archive leaderboard report
Classification MHIST Supervised (ResNet-50) Accuracy 78.92 #8 of 9 Archive leaderboard report
Classification MHIST SwAV (ResNet-50) Accuracy 77.99 #9 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections