Papers › Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation

Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation

26 Sep 2024arXiv:2409.18100archive 2025-07-28

Rob A. J. de Mooij, Josien P. W. Pluim, Cian M. Scannell

Self-supervised pretraining (SSP) has shown promising results in learning from large unlabeled datasets and, thus, could be useful for automated cardiovascular magnetic resonance (CMR) short-axis cine segmentation. However, inconsistent reports of the benefits of SSP for segmentation have made it difficult to apply SSP to CMR. Therefore, this study aimed to evaluate SSP methods for CMR cine segmentation. To this end, short-axis cine stacks of 296 subjects (90618 2D slices) were used for unlabeled pretraining with four SSP methods; SimCLR, positional contrastive learning, DINO, and masked image modeling (MIM). Subsets of varying numbers of subjects were used for supervised fine-tuning of 2D models for each SSP method, as well as to train a 2D baseline model from scratch. The fine-tuned models were compared to the baseline using the 3D Dice similarity coefficient (DSC) in a test dataset of 140 subjects. The SSP methods showed no performance gains with the largest supervised fine-tuning subset compared to the baseline (DSC = 0.89). When only 10 subjects (231 2D slices) are available for supervised training, SSP using MIM (DSC = 0.86) improves over training from scratch (DSC = 0.82). This study found that SSP is valuable for CMR cine segmentation when labeled training data is scarce, but does not aid state-of-the-art deep learning methods when ample labeled data is available. Moreover, the choice of SSP method is important. The code is publicly available at: https://github.com/q-cardIA/ssp-cmr-cine-segmentation

PaperPDFCode

Code

q-cardia/ssp-cmr-cine-segmentation officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Contrastive LearningSegmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AttentionAverage PoolingColorJitterConvolutionDINODense ConnectionsFeedforward NetworkGlobal Average PoolingKaiming InitializationLayer NormalizationLinear LayerMIMMax PoolingMulti-Head AttentionNT-XentRandom Gaussian BlurRandom Resized CropReLUResidual ConnectionSimCLRSoftmaxVision Transformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections