Contrastive Learning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

16 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 3,104 papers with code (6,661 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• A Simple Framework for Contrastive Learning of Visual Representations
  13 Feb 2020 96 repositories listed Syntology ran 79 of 137 samples · 58 unverified · 52 pointer-only (licence)
  This paper presents SimCLR: a simple framework for contrastive learning of visual representations.
• Momentum Contrast for Unsupervised Visual Representation Learning
  13 Nov 2019 44 repositories listed Syntology ran 26 of 42 samples · 16 unverified · 16 pointer-only (licence)
  This enables building a large and consistent dictionary on-the-fly that facilitates contrastive unsupervised learning.
• Improved Baselines with Momentum Contrastive Learning
  9 Mar 2020 36 repositories listed Syntology ran 8 of 43 samples · 35 unverified · 10 pointer-only (licence)
  Contrastive unsupervised learning has recently shown encouraging progress, e.
• Supervised Contrastive Learning
  23 Apr 2020 26 repositories listed Syntology ran 6 of 23 samples · 17 unverified
  Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models.
• SimCSE: Simple Contrastive Learning of Sentence Embeddings
  18 Apr 2021 23 repositories listed Syntology ran 17 of 30 samples · 13 unverified · 19 pointer-only (licence)
  This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings.
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
  17 Jun 2020 18 repositories listed Syntology ran 13 of 17 samples · 4 unverified · 6 pointer-only (licence)
  In addition, we also propose a new data augmentation strategy, multi-crop, that uses a mix of views with different resolutions in place of two full-resolution views, without increasing the memory or compute requirements…
• Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination
  5 May 2018 15 repositories listed Syntology ran 19 of 23 samples · 4 unverified · 16 pointer-only (licence)
  Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so.
• Sigmoid Loss for Language Image Pre-Training
  27 Mar 2023 11 repositories listed Syntology ran 12 of 29 samples · 17 unverified · 25 pointer-only (licence)
  We propose a simple pairwise Sigmoid loss for Language-Image Pre-training (SigLIP).
• Contrastive Learning for Compact Single Image Dehazing
  19 Apr 2021 10 repositories listed
  In this paper, we propose a novel contrastive regularization (CR) built upon contrastive learning to exploit both the information of hazy images and clear images as negative and positive samples, respectively.
• Contrastive Learning for Unpaired Image-to-Image Translation
  30 Jul 2020 10 repositories listed Syntology ran 9 of 9 samples · 0 unverified
  Furthermore, we draw negatives from within the input image itself, rather than from the rest of the dataset.
• Contrastive Multiview Coding
  13 Jun 2019 8 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 1 pointer-only (licence)
  We analyze key properties of the approach that make it work, finding that the contrastive loss outperforms a popular alternative based on cross-view prediction, and that the more views we learn from, the better the…
• Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup
  18 Jan 2021 7 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Contrastive learning has been applied successfully to learn vector representations of text.
• Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning
  19 Nov 2020 7 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 3 pointer-only (licence)
  We argue that the power of contrastive learning has yet to be fully unleashed, as current methods are trained only on instance-level pretext tasks, leading to representations that may be sub-optimal for downstream tasks…
• Dense Contrastive Learning for Self-Supervised Visual Pre-Training
  18 Nov 2020 7 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Compared to the baseline method MoCo-v2, our method introduces negligible computation overhead (only <1% slower), but demonstrates consistently superior performance when transferring to downstream dense prediction tasks…
• Contrastive Learning of Medical Visual Representations from Paired Images and Text
  2 Oct 2020 7 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  Existing work commonly relies on fine-tuning weights transferred from ImageNet pretraining, which is suboptimal due to drastically different image characteristics, or rule-based label extraction from the textual report…
• CURL: Contrastive Unsupervised Representations for Reinforcement Learning
  8 Apr 2020 7 repositories listed Syntology ran 6 of 8 samples · 2 unverified
  On the DeepMind Control Suite, CURL is the first image-based algorithm to nearly match the sample-efficiency of methods that use state-based features.
• Self-Supervised Learning of Pretext-Invariant Representations
  4 Dec 2019 7 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  The goal of self-supervised learning from images is to construct image representations that are semantically meaningful via pretext tasks that do not require semantic annotations for a large training set of images.
• LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  3 Oct 2023 6 repositories listed Syntology ran 7 of 14 samples · 7 unverified
  We thus propose VIDAL-10M with Video, Infrared, Depth, Audio and their corresponding Language, naming as VIDAL-10M.
• Unsupervised Dense Information Retrieval with Contrastive Learning
  16 Dec 2021 6 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers and show that it leads to strong performance in various retrieval settings.
• Model-Contrastive Federated Learning
  30 Mar 2021 6 repositories listed Syntology ran 2 of 9 samples · 7 unverified
  A key challenge in federated learning is to handle the heterogeneity of local data distribution across parties.
• Pre-Trained Image Processing Transformer
  1 Dec 2020 6 repositories listed
  To maximally excavate the capability of transformer, we present to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs.
• Hyperspherical Consistency Regularization
  2 Jun 2022 5 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  Though it benefits from taking advantage of both feature-dependent information from self-supervised learning and label-dependent information from supervised learning, this scheme remains suffering from bias of the…
• Revisiting 3D ResNets for Video Recognition
  3 Sep 2021 5 repositories listed
  A recent work from Bello shows that training and scaling strategies may be more significant than model architectures for visual recognition.
• Parametric Contrastive Learning
  26 Jul 2021 5 repositories listed Syntology ran 1 of 3 samples · 2 unverified · 1 pointer-only (licence)
  In this paper, we propose Parametric Contrastive Learning (PaCo) to tackle long-tailed recognition.
• Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective
  31 Mar 2021 5 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  To learn generalizable representation for correspondence in large-scale, a variety of self-supervised pretext tasks are proposed to explicitly perform object-level or patch-level similarity learning.
• Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
  1 Jul 2020 5 repositories listed Syntology ran 3 of 12 samples · 9 unverified
  In this paper, we identify that the main bottleneck is in the training mechanisms, where the negative instances used in training are not representative of the irrelevant documents in testing.
• On Contrastive Learning for Likelihood-free Inference
  10 Feb 2020 5 repositories listed
  Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible.
• Self-labelling via simultaneous clustering and representation learning
  13 Nov 2019 5 repositories listed Syntology ran 7 of 18 samples · 11 unverified · 3 pointer-only (licence)
  Combining clustering and representation learning is one of the most promising approaches for unsupervised learning of deep neural networks.
• CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale
  27 May 2024 4 repositories listed Syntology ran 4 of 12 samples · 8 unverified
  Measuring biodiversity is crucial for understanding ecosystem health.
• Decoding Natural Images from EEG for Object Recognition
  25 Aug 2023 4 repositories listed Syntology ran 7 of 12 samples · 5 unverified
  This paper presents a self-supervised framework to demonstrate the feasibility of learning image representations from EEG signals, particularly for object recognition.

Syntology lines on 26 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.