Methods › General › Self-Supervised Learning › BYOL
Bootstrap Your Own Latent
BYOL
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
BYOL (Bootstrap Your Own Latent) is a new approach to self-supervised learning. BYOL’s goal is to learn a representation y_θ which can then be used for downstream tasks. BYOL uses two neural networks to learn: the online and target networks. The online network is defined by a set of weights θ and is comprised of three stages: an encoder f_θ, a projector g_θ and a predictor q_θ. The target network has the same architecture as the online network, but uses a different set of weights ξ. The target network provides the regression targets to train the online network, and its parameters ξ are an exponential moving average of the online parameters θ.
Given the architecture diagram on the right, BYOL minimizes a similarity loss between q_θ(z_θ) and sg(z′_ξ), where θ are the trained weights, ξ are an exponential moving average of θ and sg means stop-gradient. At the end of training, everything but f_θ is discarded, and y_θ is used as the image representation.
Source: Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
Image credit: Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
Papers archive 2025-07-28
30 shown of 123, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Representation Learning via Non-Contrastive Mutual Information 23 Apr 2025 · 0 repositories · arXiv:2504.16667
-
Variational Self-Supervised Learning 6 Apr 2025 · 0 repositories · arXiv:2504.04318
-
Implicit Contrastive Representation Learning with Guided Stop-gradient 12 Mar 2025 · 1 repository · arXiv:2503.09058Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
Adversarial network embedding with bootstrapped representations for sparse networks 3 Mar 2025 · 1 repository
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" 21 Dec 2024 · 1 repository · arXiv:2412.16522
-
Self-Supervised Radiograph Anatomical Region Classification -- How Clean Is Your Real-World Data? 20 Dec 2024 · 0 repositories · arXiv:2412.15967
-
Maximising Histopathology Segmentation using Minimal Labels via Self-Supervision 19 Dec 2024 · 0 repositories · arXiv:2412.15389
-
Bridge: A Unified Framework to Knowledge Graph Completion via Language Models and Knowledge Representation 11 Nov 2024 · 0 repositories · arXiv:2411.06660
-
Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods 5 Oct 2024 · 0 repositories · arXiv:2410.04289
-
Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition 23 Sep 2024 · 1 repository
-
Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT 16 Sep 2024 · 1 repository · arXiv:2409.10103
-
Unfolding Videos Dynamics via Taylor Expansion 4 Sep 2024 · 0 repositories · arXiv:2409.02371
-
CNN-JEPA: Self-Supervised Pretraining Convolutional Neural Networks Using Joint Embedding Predictive Architecture 14 Aug 2024 · 1 repository · arXiv:2408.07514
-
Efficiency for Free: Ideal Data Are Transportable Representations 23 May 2024 · 1 repository · arXiv:2405.14669
-
Self-supervised learning for classifying paranasal anomalies in the maxillary sinus 29 Apr 2024 · 1 repository · arXiv:2404.18599
-
Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition 16 Apr 2024 · 0 repositories · arXiv:2404.10405
-
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework 9 Apr 2024 · 2 repositories · arXiv:2404.06095Syntology ran 7 of 7 samples · 0 unverified · 7 pointer-only (licence)
-
Self-supervised Visualisation of Medical Image Datasets 22 Feb 2024 · 1 repository · arXiv:2402.14566
-
The Common Stability Mechanism behind most Self-Supervised Learning Approaches 22 Feb 2024 · 1 repository · arXiv:2402.14957
-
WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization 14 Feb 2024 · 0 repositories · arXiv:2402.09586
-
GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning 3 Jan 2024 · 1 repository · arXiv:2401.01990
-
Bootstrap Your Own Variance 6 Dec 2023 · 0 repositories · arXiv:2312.03213
-
SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer 2 Dec 2023 · 0 repositories · arXiv:2312.01187
-
CUCL: Codebook for Unsupervised Continual Learning 25 Nov 2023 · 1 repository · arXiv:2311.14911
-
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics 28 Sep 2023 · 0 repositories · arXiv:2309.16109
-
Adapting Self-Supervised Representations to Multi-Domain Setups 7 Sep 2023 · 0 repositories · arXiv:2309.03999
-
Feature-Suppressed Contrast for Self-Supervised Food Pre-training 7 Aug 2023 · 1 repository · arXiv:2308.03272
-
VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization 31 Jul 2023 · 1 repository · arXiv:2308.00090
-
Self-Supervised Learning for Improved Synthetic Aperture Sonar Target Recognition 27 Jul 2023 · 0 repositories · arXiv:2307.15098
Tasks archive 2025-07-28
20 shown of 124 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections