Methods › General › Loss Functions › Supervised Contrastive Loss
Supervised Contrastive Loss
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Supervised Contrastive Loss is an alternative loss function to cross entropy that the authors argue can leverage label information more effectively. Clusters of points belonging to the same class are pulled together in embedding space, while simultaneously pushing apart clusters of samples from different classes.
ℒˢᵘᵖ=∑ᵢ₌₁²ᴺℒᵢˢᵘᵖ
ℒᵢˢᵘᵖ=(-1)/(2N_(ỹᵢ)-1)∑ⱼ₌₁²ᴺ1_(i≠j)·1_(ỹᵢ=ỹⱼ)·log(exp(zᵢ·zⱼ/τ))/(∑ₖ₌₁²ᴺ1_(i≠k)·exp(zᵢ·zₖ/τ))
where N_(ỹᵢ) is the total number of images in the minibatch that have the same label, ỹᵢ, as the anchor, i. This loss has important properties well suited for supervised learning: (a) generalization to an arbitrary number of positives, (b) contrastive power increases with more negatives.
Papers archive 2025-07-28
30 shown of 76, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Self-Supervised Contrastive Learning is Approximately Supervised Contrastive Learning 4 Jun 2025 · 0 repositories · arXiv:2506.04411
-
MSA-UNet3+: Multi-Scale Attention UNet3+ with New Supervised Prototypical Contrastive Loss for Coronary DSA Image Segmentation 7 Apr 2025 · 0 repositories · arXiv:2504.05184
-
DFCon: Attention-Driven Supervised Contrastive Learning for Robust Deepfake Detection 28 Jan 2025 · 0 repositories · arXiv:2501.16704
-
An Inclusive Theoretical Framework of Robust Supervised Contrastive Loss against Label Noise 2 Jan 2025 · 0 repositories · arXiv:2501.01130
-
Transformer-Based Contrastive Meta-Learning For Low-Resource Generalizable Activity Recognition 28 Dec 2024 · 0 repositories · arXiv:2412.20290
-
Multi-Label Contrastive Learning : A Comprehensive Study 27 Nov 2024 · 1 repository · arXiv:2412.00101
-
JEMA: A Joint Embedding Framework for Scalable Co-Learning with Multimodal Alignment 31 Oct 2024 · 0 repositories · arXiv:2410.23988
-
FedCCRL: Federated Domain Generalization with Cross-Client Representation Learning 15 Oct 2024 · 1 repository · arXiv:2410.11267
-
A Unified Contrastive Loss for Self-Training 11 Sep 2024 · 0 repositories · arXiv:2409.07292
-
Out of spuriousity: Improving robustness to spurious correlations without group annotations 20 Jul 2024 · 0 repositories · arXiv:2407.14974
-
ETSCL: An Evidence Theory-Based Supervised Contrastive Learning Framework for Multi-modal Glaucoma Grading 19 Jul 2024 · 1 repository · arXiv:2407.14230
-
Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization 19 Jun 2024 · 1 repository · arXiv:2406.13565
-
Unleashing the Potential of Open-set Noisy Samples Against Label Noise for Medical Image Classification 18 Jun 2024 · 0 repositories · arXiv:2406.12293
-
Taxes Are All You Need: Integration of Taxonomical Hierarchy Relationships into the Contrastive Loss 10 Jun 2024 · 0 repositories · arXiv:2406.06848
-
Classification of Breast Cancer Histopathology Images using a Modified Supervised Contrastive Learning Method 6 May 2024 · 1 repository · arXiv:2405.03642
-
DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series 17 Apr 2024 · 1 repository · arXiv:2404.11269Syntology ran 1 of 1 samples · 0 unverified
-
Fair Graph Neural Network with Supervised Contrastive Regularization 9 Apr 2024 · 0 repositories · arXiv:2404.06090
-
Time Series Representation Learning with Supervised Contrastive Temporal Transformer 16 Mar 2024 · 1 repository · arXiv:2403.10787
-
Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering 18 Feb 2024 · 1 repository · arXiv:2402.11523Syntology ran 1 of 2 samples · 1 unverified
-
Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning 26 Dec 2023 · 0 repositories · arXiv:2312.15869
-
Long-Tail Learning with Rebalanced Contrastive Loss 4 Dec 2023 · 0 repositories · arXiv:2312.01753
-
Contrastive Learning of View-Invariant Representations for Facial Expressions Recognition 12 Nov 2023 · 0 repositories · arXiv:2311.06852
-
Understanding writing style in social media with a supervised contrastively pre-trained transformer 17 Oct 2023 · 1 repository · arXiv:2310.11081
-
Semi-Supervised End-To-End Contrastive Learning For Time Series Classification 13 Oct 2023 · 0 repositories · arXiv:2310.08848
-
Continual Contrastive Spoken Language Understanding 4 Oct 2023 · 0 repositories · arXiv:2310.02699
-
SALSA: Semantically-Aware Latent Space Autoencoder 4 Oct 2023 · 0 repositories · arXiv:2310.02744
-
When hard negative sampling meets supervised contrastive learning 28 Aug 2023 · 0 repositories · arXiv:2308.14893
-
RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification 4 Aug 2023 · 0 repositories · arXiv:2308.02335
-
Contrastive Learning for API Aspect Analysis 31 Jul 2023 · 2 repositories · arXiv:2307.16878
-
Neural Memory Decoding with EEG Data and Representation Learning 25 Jul 2023 · 0 repositories · arXiv:2307.13181
Tasks archive 2025-07-28
20 shown of 132 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections