Methods › General › Loss Functions › InfoNCE
InfoNCE
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
InfoNCE, where NCE stands for Noise-Contrastive Estimation, is a type of contrastive loss function used for self-supervised learning.
Given a set X ={x₁, …, x_N} of N random samples containing one positive sample from p(xₜ₊ₖ|cₜ) and N − 1 negative samples from the 'proposal' distribution p(xₜ₊ₖ), we optimize:
ℒ_N = - 𝔼_X[log(fₖ(xₜ₊ₖ, cₜ))/(∑_(xⱼ∈X)fₖ(xⱼ, cₜ))]
Optimizing this loss will result in fₖ(xₜ₊ₖ, cₜ) estimating the density ratio, which is:
fₖ(xₜ₊ₖ, cₜ) ∝(p(xₜ₊ₖ|cₜ))/(p(xₜ₊ₖ))
In Syntology the paper matched by title, arXiv:2407.00143, held, no code (no_code; paper_only). The lookup matched a paper by its title, arXiv:2407.00143, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2407.00143) is about this method is not checked; it does not say whether this method has code.
Origin paper of this answer, arXiv:2407.00143 (its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 418 · with a code link: 217 · where Syntology ran a sample: 89 (72 with a run with no instrument failure, 17 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (89 of 418 tagged: 72 with a run with no instrument failure, 17 where every run was a failure of Syntology's instrument)
Page 1 of 5: papers 1 to 100 of 418, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Generalizing Supervised Contrastive learning: A Projection Perspective 11 Jun 2025 · 0 repositories · arXiv:2506.09810
-
Probabilistic Variational Contrastive Learning 11 Jun 2025 · 0 repositories · arXiv:2506.10159
-
Integration of Contrastive Predictive Coding and Spiking Neural Networks 10 Jun 2025 · 1 repository · arXiv:2506.09194
-
Conventional Contrastive Learning Often Falls Short: Improving Dense Retrieval with Cross-Encoder Listwise Distillation and Synthetic Data 25 May 2025 · 1 repository · arXiv:2505.19274
-
Graph-Supported Dynamic Algorithm Configuration for Multi-Objective Combinatorial Optimization 22 May 2025 · 1 repository · arXiv:2505.16471Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Contrastive Alignment with Semantic Gap-Aware Corrections in Text-Video Retrieval 18 May 2025 · 1 repository · arXiv:2505.12499
-
Adversarial Robustness for Unified Multi-Modal Encoders via Efficient Calibration 17 May 2025 · 0 repositories · arXiv:2505.11895
-
Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning 12 May 2025 · 0 repositories · arXiv:2505.07921
-
sEEG-based Encoding for Sentence Retrieval: A Contrastive Learning Approach to Brain-Language Alignment 20 Apr 2025 · 0 repositories · arXiv:2504.14468
-
Koopman-Based Event-Triggered Control from Data 19 Apr 2025 · 0 repositories · arXiv:2504.14334
-
Variational Self-Supervised Learning 6 Apr 2025 · 0 repositories · arXiv:2504.04318
-
Node Embeddings via Neighbor Embeddings 31 Mar 2025 · 0 repositories · arXiv:2503.23822
-
Beyond Contrastive Learning: Synthetic Data Enables List-wise Training with Multiple Levels of Relevance 29 Mar 2025 · 1 repository · arXiv:2503.23239
-
Does GCL Need a Large Number of Negative Samples? Enhancing Graph Contrastive Learning with Effective and Efficient Negative Sampling 23 Mar 2025 · 1 repository · arXiv:2503.17908Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Weighted Graph Structure Learning with Attention Denoising for Node Classification 15 Mar 2025 · 1 repository · arXiv:2503.12157
-
OASIS: Order-Augmented Strategy for Improved Code Search 11 Mar 2025 · 0 repositories · arXiv:2503.08161Syntology 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Advancing Vietnamese Information Retrieval with Learning Objective and Benchmark 10 Mar 2025 · 0 repositories · arXiv:2503.07470
-
Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation 10 Mar 2025 · 0 repositories · arXiv:2503.06976
-
Learning Transformer-based World Models with Contrastive Predictive Coding 6 Mar 2025 · 0 repositories · arXiv:2503.04416
-
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning 4 Mar 2025 · 0 repositories · arXiv:2503.04812
-
Teaching Dense Retrieval Models to Specialize with Listwise Distillation and LLM Data Augmentation 27 Feb 2025 · 1 repository · arXiv:2502.19712
-
Distributional Vision-Language Alignment by Cauchy-Schwarz Divergence 24 Feb 2025 · 0 repositories · arXiv:2502.17028
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Temperature-Free Loss Function for Contrastive Learning 29 Jan 2025 · 0 repositories · arXiv:2501.17683
-
CSPCL: Category Semantic Prior Contrastive Learning for Deformable DETR-Based Prohibited Item Detectors 28 Jan 2025 · 0 repositories · arXiv:2501.16665
-
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? 26 Jan 2025 · 0 repositories · arXiv:2501.15431
-
Contrastive Representation Learning Helps Cross-institutional Knowledge Transfer: A Study in Pediatric Ventilation Management 23 Jan 2025 · 0 repositories · arXiv:2501.13587
-
Language modulates vision: Evidence from neural networks and human brain-lesion models 23 Jan 2025 · 0 repositories · arXiv:2501.13628
-
An Inclusive Theoretical Framework of Robust Supervised Contrastive Loss against Label Noise 2 Jan 2025 · 0 repositories · arXiv:2501.01130
-
Performance-Barrier Event-Triggered PDE Control of Traffic Flow 1 Jan 2025 · 0 repositories · arXiv:2501.00722
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
DomCLP: Domain-wise Contrastive Learning with Prototype Mixup for Unsupervised Domain Generalization 12 Dec 2024 · 1 repository · arXiv:2412.09074
-
Automated Toll Management System Using RFID and Image Processing 2 Dec 2024 · 0 repositories · arXiv:2412.01728
-
CV-Cities: Advancing Cross-View Geo-Localization in Global Cities 19 Nov 2024 · 1 repository · arXiv:2411.12431Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
SCAN: Bootstrapping Contrastive Pre-training for Data Efficiency 14 Nov 2024 · 1 repository · arXiv:2411.09126
-
A Contrastive Self-Supervised Learning scheme for beat tracking amenable to few-shot learning 6 Nov 2024 · 0 repositories · arXiv:2411.04152
-
Understanding Contrastive Learning via Gaussian Mixture Models 5 Nov 2024 · 0 repositories · arXiv:2411.03517
-
HEX: Hierarchical Emergence Exploitation in Self-Supervised Algorithms 30 Oct 2024 · 1 repository · arXiv:2410.23200
-
Accelerating Augmentation Invariance Pretraining 27 Oct 2024 · 0 repositories · arXiv:2410.22364
-
SRA: A Novel Method to Improve Feature Embedding in Self-supervised Learning for Histopathological Images 23 Oct 2024 · 0 repositories · arXiv:2410.17514
-
TAS: Distilling Arbitrary Teacher and Student via a Hybrid Assistant 16 Oct 2024 · 0 repositories · arXiv:2410.12342
-
SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual Representations 3 Oct 2024 · 1 repository · arXiv:2410.02401
-
Prototype based Masked Audio Model for Self-Supervised Learning of Sound Event Detection 26 Sep 2024 · 1 repository · arXiv:2409.17656
-
Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation 25 Sep 2024 · 1 repository · arXiv:2409.16921Syntology official (archive's flag): 3 ran · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 5 pointer-only (licence)
-
Trading through Earnings Seasons using Self-Supervised Contrastive Representation Learning 25 Sep 2024 · 0 repositories · arXiv:2409.17392
-
Upper-body free-breathing Magnetic Resonance Fingerprinting applied to the quantification of water T1 and fat fraction 24 Sep 2024 · 1 repository · arXiv:2409.16200
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 23 Sep 2024 · 1 repository
-
Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing 20 Sep 2024 · 1 repository
-
Embedding Geometries of Contrastive Language-Image Pre-Training 19 Sep 2024 · 1 repository · arXiv:2409.13079Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensing 16 Sep 2024 · 1 repository · arXiv:2410.01825
-
Hierarchical Event-Triggered Systems: Safe Learning of Quasi-Optimal Deadline Policies 15 Sep 2024 · 0 repositories · arXiv:2409.09812
-
Speaker and Style Disentanglement of Speech Based on Contrastive Predictive Coding Supported Factorized Variational Autoencoder 5 Sep 2024 · 0 repositories · arXiv:2409.03520
-
Interpretable Convolutional SyncNet 2 Sep 2024 · 0 repositories · arXiv:2409.00971
-
ProteinRPN: Towards Accurate Protein Function Prediction with Graph-Based Region Proposals 1 Sep 2024 · 0 repositories · arXiv:2409.00610
-
Uncertainties of Latent Representations in Computer Vision 26 Aug 2024 · 0 repositories · arXiv:2408.14281
-
Smooth InfoMax -- Towards easier Post-Hoc interpretability 23 Aug 2024 · 1 repository · arXiv:2408.12936
-
Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks 22 Aug 2024 · 1 repository · arXiv:2408.12753
-
Accelerating Goal-Conditioned RL Algorithms and Research 20 Aug 2024 · 1 repository · arXiv:2408.11052Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
-
DRL-Based Resource Allocation for Motion Blur Resistant Federated Self-Supervised Learning in IoV 17 Aug 2024 · 1 repository · arXiv:2408.09194
-
Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning 12 Aug 2024 · 0 repositories · arXiv:2408.05956
-
Contrastive Learning for Image Complexity Representation 6 Aug 2024 · 0 repositories · arXiv:2408.03230
-
Relational Representation Distillation 16 Jul 2024 · 1 repository · arXiv:2407.12073
-
Performance-Barrier Event-Triggered Control of a Class of Reaction-Diffusion PDEs 11 Jul 2024 · 0 repositories · arXiv:2407.08178
-
Contrastive Learning of Preferences with a Contextual InfoNCE Loss 8 Jul 2024 · 0 repositories · arXiv:2407.05898
-
InfoNCE: Identifying the Gap Between Theory and Practice 28 Jun 2024 · 0 repositories · arXiv:2407.00143
-
A Gradient Accumulation Method for Dense Retriever under Memory Constraint 18 Jun 2024 · 0 repositories · arXiv:2406.12356
-
SViTT-Ego: A Sparse Video-Text Transformer for Egocentric Video 13 Jun 2024 · 0 repositories · arXiv:2406.09462
-
Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing 5 Jun 2024 · 0 repositories · arXiv:2406.03603
-
Contextual Dynamic Pricing: Algorithms, Optimality, and Local Differential Privacy Constraints 4 Jun 2024 · 0 repositories · arXiv:2406.02424
-
Causal Contrastive Learning for Counterfactual Regression Over Time 1 Jun 2024 · 0 repositories · arXiv:2406.00535
-
Rethinking Spectral Augmentation for Contrast-based Graph Self-Supervised Learning 30 May 2024 · 0 repositories · arXiv:2405.19600
-
WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization 28 May 2024 · 0 repositories · arXiv:2405.18405
-
Negative as Positive: Enhancing Out-of-distribution Generalization for Graph Contrastive Learning 25 May 2024 · 0 repositories · arXiv:2405.16224
-
ProtFAD: Introducing function-aware domains as implicit modality towards protein function prediction 24 May 2024 · 2 repositories · arXiv:2405.15158
-
Offline Reinforcement Learning from Datasets with Structured Non-Stationarity 23 May 2024 · 1 repository · arXiv:2405.14114Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
-
Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization 14 May 2024 · 0 repositories · arXiv:2405.08604
-
Weighted Point Cloud Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metric 30 Apr 2024 · 0 repositories · arXiv:2404.19228Syntology 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations 23 Apr 2024 · 1 repository · arXiv:2404.14913
-
CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective 22 Apr 2024 · 1 repository · arXiv:2404.14109
-
Towards noise contrastive estimation with soft targets for conditional models 22 Apr 2024 · 1 repository · arXiv:2404.14076Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Preventing Collapse in Contrastive Learning with Orthonormal Prototypes (CLOP) 27 Mar 2024 · 0 repositories · arXiv:2403.18699
-
Multilingual Turn-taking Prediction Using Voice Activity Projection 11 Mar 2024 · 0 repositories · arXiv:2403.06487
-
Event-Triggered Robust Cooperative Output Regulation for a Class of Linear Multi-Agent Systems with an Unknown Exosystem 1 Mar 2024 · 0 repositories · arXiv:2403.00645
-
Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation 22 Feb 2024 · 0 repositories · arXiv:2402.14611
-
Analysis of Using Sigmoid Loss for Contrastive Learning 20 Feb 2024 · 0 repositories · arXiv:2402.12613
-
f-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning 15 Feb 2024 · 0 repositories · arXiv:2402.10150
-
Moco: A Learnable Meta Optimizer for Combinatorial Optimization 7 Feb 2024 · 1 repository · arXiv:2402.04915Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)
-
Revisiting speech segmentation and lexicon learning with better features 31 Jan 2024 · 0 repositories · arXiv:2401.17902
-
Curriculum Recommendations Using Transformer Base Model with InfoNCE Loss And Language Switching Method 18 Jan 2024 · 0 repositories · arXiv:2401.09699
-
DiffClone: Enhanced Behaviour Cloning in Robotics with Diffusion-Driven Policy Learning 17 Jan 2024 · 1 repository · arXiv:2401.09243Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speech 12 Jan 2024 · 0 repositories · arXiv:2401.06485
-
Real-time and Continuous Turn-taking Prediction Using Voice Activity Projection 10 Jan 2024 · 2 repositories · arXiv:2401.04868
-
Reinforcement Learning for Optimizing RAG for Domain Chatbots 10 Jan 2024 · 0 repositories · arXiv:2401.06800
-
A Novel Transformer-Based Self-Supervised Learning Method to Enhance Photoplethysmogram Signal Artifact Detection 2 Jan 2024 · 0 repositories · arXiv:2401.01013
-
Replication-proof Bandit Mechanism Design with Bayesian Agents 28 Dec 2023 · 0 repositories · arXiv:2312.16896
-
A Beam-Segmenting Polar Format Algorithm Based on Double PCS for Video SAR Persistent Imaging 19 Dec 2023 · 0 repositories · arXiv:2401.10252
-
Time-Series Contrastive Learning against False Negatives and Class Imbalance 19 Dec 2023 · 0 repositories · arXiv:2312.11939
-
(Debiased) Contrastive Learning Loss for Recommendation (Technical Report) 13 Dec 2023 · 0 repositories · arXiv:2312.08517
-
Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report) 13 Dec 2023 · 0 repositories · arXiv:2312.08520
-
AT4CTR: Auxiliary Match Tasks for Enhancing Click-Through Rate Prediction 9 Dec 2023 · 0 repositories · arXiv:2312.06683
Tasks archive 2025-07-28
20 shown of 343 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections