Methods › General › Semi-Supervised Learning Methods › MoCo v2
MoCo v2
Introduced by Xinlei Chen et al. in Improved Baselines with Momentum Contrastive Learning
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
MoCo v2 is an improved version of the Momentum Contrast self-supervised learning algorithm. Motivated by the findings presented in the SimCLR paper, authors:
- Replace the 1-layer fully connected layer with a 2-layer MLP head with ReLU for the unsupervised training stage.
- Include blur augmentation.
- Use cosine learning rate schedule.
These modifications enable MoCo to outperform the state-of-the-art SimCLR with a smaller batch size and fewer epochs.
Papers archive 2025-07-28
30 shown of 30, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
Contrastive Learning for Image Complexity Representation 6 Aug 2024 · 0 repositories · arXiv:2408.03230
-
Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation 22 Feb 2024 · 0 repositories · arXiv:2402.14611
-
SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer 2 Dec 2023 · 0 repositories · arXiv:2312.01187
-
Matrix Information Theory for Self-Supervised Learning 27 May 2023 · 3 repositories · arXiv:2305.17326Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
-
MoBYv2AL: Self-supervised Active Learning for Image Classification 4 Jan 2023 · 1 repository · arXiv:2301.01531
-
Revisiting the Critical Factors of Augmentation-Invariant Representation Learning 30 Jul 2022 · 1 repository · arXiv:2208.00275Syntology ran 2 of 5 samples · 3 unverified
-
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo 30 Mar 2022 · 2 repositories · arXiv:2203.17248Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
DATA: Domain-Aware and Task-Aware Self-supervised Learning 17 Mar 2022 · 1 repository · arXiv:2203.09041Syntology ran 0 of 2 samples · 2 unverified
-
InsCon:Instance Consistency Feature Representation via Self-Supervised Learning 15 Mar 2022 · 0 repositories · arXiv:2203.07688
-
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features 3 Mar 2022 · 0 repositories · arXiv:2203.01881
-
Energy-Based Contrastive Learning of Visual Representations 10 Feb 2022 · 1 repository · arXiv:2202.04933Syntology ran 12 of 14 samples · 2 unverified · 14 pointer-only (licence)
-
Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning 26 Nov 2021 · 1 repository · arXiv:2111.13651
-
RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning? 24 Nov 2021 · 2 repositories · arXiv:2111.12309
-
8-bit Optimizers via Block-wise Quantization 6 Oct 2021 · 3 repositories · arXiv:2110.02861
-
Piecing and Chipping: An effective solution for the information-erasing view generation in Self-supervised Learning 29 Sep 2021 · 0 repositories
-
Self-Supervised Visual Representations Learning by Contrastive Mask Prediction 18 Aug 2021 · 0 repositories · arXiv:2108.07954
-
Self-Supervised Learning with Swin Transformers 10 May 2021 · 6 repositories · arXiv:2105.04553
-
Jigsaw Clustering for Unsupervised Visual Representation Learning 1 Apr 2021 · 1 repository · arXiv:2104.00323
-
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors 8 Mar 2021 · 0 repositories · arXiv:2103.04814
-
SEED: Self-supervised Distillation For Visual Representation 12 Jan 2021 · 1 repository · arXiv:2101.04731Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
CEM500K – A large-scale heterogeneous unlabeled cellular electron microscopy image dataset for deep learning 11 Dec 2020 · 1 repository
-
Self-Supervision Closes the Gap Between Weak and Strong Supervision in Histology 7 Dec 2020 · 0 repositories · arXiv:2012.03583
-
How Well Do Self-Supervised Models Transfer? 26 Nov 2020 · 1 repository · arXiv:2011.13377Syntology ran 4 of 5 samples · 1 unverified
-
Are all negatives created equal in contrastive instance discrimination? 13 Oct 2020 · 0 repositories · arXiv:2010.06682
-
EqCo: Equivalent Rules for Self-supervised Contrastive Learning 5 Oct 2020 · 1 repository · arXiv:2010.01929
-
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination 9 Aug 2020 · 2 repositories · arXiv:2008.03813Syntology ran 2 of 8 samples · 6 unverified
-
Parametric Instance Classification for Unsupervised Visual Feature Learning 25 Jun 2020 · 1 repository · arXiv:2006.14618
-
SCAN: Learning to Classify Images without Labels 25 May 2020 · 2 repositories · arXiv:2005.12320
-
Improved Baselines with Momentum Contrastive Learning 9 Mar 2020 · 36 repositories · arXiv:2003.04297Syntology ran 8 of 43 samples · 35 unverified · 10 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 49 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections