Methods › General › Loss Functions › NT-Xent
Normalized Temperature-scaled Cross Entropy Loss
NT-Xent
Introduced by Kihyuk Sohn in Improved Deep Metric Learning with Multi-class N-pair Loss Objective
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
NT-Xent, or Normalized Temperature-scaled Cross Entropy Loss, is a loss function. Let sim(𝐮, 𝐯) = 𝐮ᵀ𝐯/||𝐮|| ||𝐯|| denote the cosine similarity between two vectors 𝐮 and 𝐯. Then the loss function for a positive pair of examples (i, j) is :
𝕝_(i,j) = -log(exp(sim(𝐳ᵢ, 𝐳ⱼ)/τ))/(∑²ᴺₖ₌₁1_([k≠i])exp(sim(𝐳ᵢ, 𝐳ₖ)/τ))
where 1_([k≠i]) ∈{$0, 1$} is an indicator function evaluating to $1$ iff k≠i and τ denotes a temperature parameter. The final loss is computed across all positive pairs, both (i, j) and (j, i), in a mini-batch.
Source: SimCLR
Papers archive 2025-07-28
30 shown of 251, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Low-resource keyword spotting using contrastively trained transformer acoustic word embeddings 21 Jun 2025 · 0 repositories · arXiv:2506.17690
-
Probabilistic Variational Contrastive Learning 11 Jun 2025 · 0 repositories · arXiv:2506.10159
-
scSSL-Bench: Benchmarking Self-Supervised Learning for Single-Cell Data 10 Jun 2025 · 1 repository · arXiv:2506.10031
-
Circumventing Backdoor Space via Weight Symmetry 9 Jun 2025 · 1 repository · arXiv:2506.07467
-
SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification 20 May 2025 · 1 repository · arXiv:2505.14561
-
Representation Learning via Non-Contrastive Mutual Information 23 Apr 2025 · 0 repositories · arXiv:2504.16667
-
Impact of Language Guidance: A Reproducibility Study 10 Apr 2025 · 0 repositories · arXiv:2504.08140
-
Unsupervised Detection of Fraudulent Transactions in E-commerce Using Contrastive Learning 24 Mar 2025 · 0 repositories · arXiv:2503.18841
-
A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics 21 Mar 2025 · 0 repositories · arXiv:2503.17538
-
SinSim: Sinkhorn-Regularized SimCLR 13 Feb 2025 · 0 repositories · arXiv:2502.10478
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Self-Supervised Frameworks for Speaker Verification via Bootstrapped Positive Sampling 29 Jan 2025 · 1 repository · arXiv:2501.17772
-
Bridging Contrastive Learning and Domain Adaptation: Theoretical Perspective and Practical Application 28 Jan 2025 · 0 repositories · arXiv:2502.00052
-
Learning Compact and Robust Representations for Anomaly Detection 9 Jan 2025 · 0 repositories · arXiv:2501.05130
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
Self-Supervised Radiograph Anatomical Region Classification -- How Clean Is Your Real-World Data? 20 Dec 2024 · 0 repositories · arXiv:2412.15967
-
Maximising Histopathology Segmentation using Minimal Labels via Self-Supervision 19 Dec 2024 · 0 repositories · arXiv:2412.15389
-
AmCLR: Unified Augmented Learning for Cross-Modal Representations 10 Dec 2024 · 1 repository · arXiv:2412.07979
-
Mitigating Instance-Dependent Label Noise: Integrating Self-Supervised Pretraining with Pseudo-Label Refinement 6 Dec 2024 · 0 repositories · arXiv:2412.04898
-
Tight PAC-Bayesian Risk Certificates for Contrastive Learning 4 Dec 2024 · 1 repository · arXiv:2412.03486
-
Explorations in Self-Supervised Learning: Dataset Composition Testing for Object Classification 1 Dec 2024 · 0 repositories · arXiv:2412.00770
-
Breccia and basalt classification of thin sections of Apollo rocks with deep learning 28 Oct 2024 · 1 repository · arXiv:2410.21024
-
Accelerating Augmentation Invariance Pretraining 27 Oct 2024 · 0 repositories · arXiv:2410.22364
-
Rethinking Positive Pairs in Contrastive Learning 23 Oct 2024 · 0 repositories · arXiv:2410.18200
-
SigCLR: Sigmoid Contrastive Learning of Visual Representations 22 Oct 2024 · 0 repositories · arXiv:2410.17427
-
Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods 5 Oct 2024 · 0 repositories · arXiv:2410.04289
-
BiSSL: Enhancing the Alignment Between Self-Supervised Pretraining and Downstream Fine-Tuning via Bilevel Optimization 3 Oct 2024 · 0 repositories · arXiv:2410.02387
-
Understanding the Benefits of SimCLR Pre-Training in Two-Layer Convolutional Neural Networks 27 Sep 2024 · 0 repositories · arXiv:2409.18685
-
Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation 26 Sep 2024 · 1 repository · arXiv:2409.18100
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 23 Sep 2024 · 1 repository
Tasks archive 2025-07-28
20 shown of 212 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections