Methods › General › Stochastic Optimization › SGD › Papers where code ran, page 2
Stochastic Gradient Descent
SGD
Papers archive 2025-07-28
archive papers tagged: 2,021 · with a code link: 591 · where Syntology ran a sample: 192 (161 with a run with no instrument failure, 31 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (192 of 2,021 tagged: 161 with a run with no instrument failure, 31 where every run was a failure of Syntology's instrument)
Syntology We ran code from the paper's repository; we did not isolate this method inside it.
Page 2 of 2: papers 101 to 192 of the 192 tagged papers where Syntology ran at least one harvested sample (161 with a run with no instrument failure, 31 where every run was a failure of Syntology's instrument), newest first by the archive's date (ties by arXiv id). This is a filter on Syntology's record ordered by date only, not a ranking; a run is not a correctness claim. A paper missing from this list is not a recorded non-run: it may have no arXiv id, no harvested code, or only samples that have not run yet.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
On Linear Stability of SGD and Input-Smoothness of Neural Networks 27 May 2021 · 1 repository · arXiv:2105.13462Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization 31 Mar 2021 · 1 repository · arXiv:2103.17182Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Repurposing Pretrained Models for Robust Out-of-domain Few-Shot Learning 16 Mar 2021 · 1 repository · arXiv:2103.09027Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Permutation-Based SGD: Is Random Optimal? 19 Feb 2021 · 1 repository · arXiv:2102.09718Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 4 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training 16 Feb 2021 · 2 repositories · arXiv:2102.08098Syntology official (archive's flag): 6 ran · 7 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples) · 12 pointer-only (licence)
-
IntSGD: Adaptive Floatless Compression of Stochastic Gradients 16 Feb 2021 · 1 repository · arXiv:2102.08374Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Learning by Turning: Neural Architecture Aware Optimisation 14 Feb 2021 · 2 repositories · arXiv:2102.07227Syntology official (archive's flag): 2 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Proximal and Federated Random Reshuffling 12 Feb 2021 · 1 repository · arXiv:2102.06704Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics 8 Dec 2020 · 1 repository · arXiv:2012.04728Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive Gradient Quantization for Data-Parallel SGD 23 Oct 2020 · 1 repository · arXiv:2010.12460Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients 15 Oct 2020 · 8 repositories · arXiv:2010.07468Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Understanding Self-supervised Learning with Dual Deep Networks 1 Oct 2020 · 2 repositories · arXiv:2010.00578Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect 28 Sep 2020 · 2 repositories · arXiv:2009.12991Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization 28 Sep 2020 · 3 repositories · arXiv:2009.13586Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Anomalous diffusion dynamics of learning in deep neural networks 22 Sep 2020 · 1 repository · arXiv:2009.10588Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 4 pointer-only (licence)
-
Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks 22 Aug 2020 · 1 repository · arXiv:2008.09777Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Obtaining Adjustable Regularization for Free via Iterate Averaging 15 Aug 2020 · 1 repository · arXiv:2008.06736Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning 8 Aug 2020 · 1 repository · arXiv:2008.03606Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Multi-Level Local SGD for Heterogeneous Hierarchical Networks 27 Jul 2020 · 1 repository · arXiv:2007.13819Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
Neural networks with late-phase weights 25 Jul 2020 · 2 repositories · arXiv:2007.12927Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
TDprop: Does Jacobi Preconditioning Help Temporal Difference Learning? 6 Jul 2020 · 0 repositories · arXiv:2007.02786Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Adai: Separating the Effects of Adaptive Learning Rate and Momentum Inertia 29 Jun 2020 · 1 repository · arXiv:2006.15815Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 3 pointer-only (licence)
-
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent 21 Jun 2020 · 1 repository · arXiv:2006.11942Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks 16 Jun 2020 · 1 repository · arXiv:2006.09313Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples)
-
Directional Pruning of Deep Neural Networks 16 Jun 2020 · 1 repository · arXiv:2006.09358Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights 15 Jun 2020 · 4 repositories · arXiv:2006.08217Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Auditing Differentially Private Machine Learning: How Private is Private SGD? 13 Jun 2020 · 1 repository · arXiv:2006.07709Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Adaptive Gradient Methods Converge Faster with Over-Parameterization (but you should do a line-search) 11 Jun 2020 · 1 repository · arXiv:2006.06835Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Random Reshuffling: Simple Analysis with Vast Improvements 10 Jun 2020 · 1 repository · arXiv:2006.05988Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning 1 Jun 2020 · 4 repositories · arXiv:2006.00719Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping 21 May 2020 · 1 repository · arXiv:2005.10785Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Understanding the Difficulty of Training Transformers 17 Apr 2020 · 2 repositories · arXiv:2004.08249Syntology official (archive's flag): 1 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
FDA: Fourier Domain Adaptation for Semantic Segmentation 11 Apr 2020 · 3 repositories · arXiv:2004.05498Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Understanding the Effects of Data Parallelism and Sparsity on Neural Network Training 25 Mar 2020 · 0 repositories · arXiv:2003.11316Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Neural Kernels Without Tangents 4 Mar 2020 · 2 repositories · arXiv:2003.02237Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
HYDRA: Pruning Adversarially Robust Neural Networks 24 Feb 2020 · 4 repositories · arXiv:2002.10509Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 15 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 19 harvested samples) · 17 pointer-only (licence)
-
Learning to Continually Learn 21 Feb 2020 · 5 repositories · arXiv:2002.09571Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
On Last-Layer Algorithms for Classification: Decoupling Representation from Uncertainty Estimation 22 Jan 2020 · 1 repository · arXiv:2001.08049Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Harmonic Convolutional Networks based on Discrete Cosine Transform 18 Jan 2020 · 1 repository · arXiv:2001.06570Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples)
-
An Empirical Study on the Intrinsic Privacy of SGD 5 Dec 2019 · 1 repository · arXiv:1912.02919Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples)
-
Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronization 30 Oct 2019 · 2 repositories · arXiv:1910.13598Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FreeAnchor: Learning to Match Anchors for Visual Object Detection 5 Sep 2019 · 4 repositories · arXiv:1909.02466Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
NUQSGD: Improved Communication Efficiency for Data-parallel SGD via Nonuniform Quantization 16 Aug 2019 · 1 repository · arXiv:1908.06077Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
The HSIC Bottleneck: Deep Learning without Back-Propagation 5 Aug 2019 · 3 repositories · arXiv:1908.01580Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 12 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk Minimization 9 Jul 2019 · 2 repositories · arXiv:1907.04371Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Learning Data Augmentation Strategies for Object Detection 26 Jun 2019 · 6 repositories · arXiv:1906.11172Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Data Cleansing for Models Trained with SGD 20 Jun 2019 · 1 repository · arXiv:1906.08473Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup 18 Jun 2019 · 3 repositories · arXiv:1906.08632Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Training Neural Networks for and by Interpolation 13 Jun 2019 · 1 repository · arXiv:1906.05661Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Bad Global Minima Exist and SGD Can Reach Them 6 Jun 2019 · 1 repository · arXiv:1906.02613Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization 31 May 2019 · 1 repository · arXiv:1905.13727Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks 27 May 2019 · 3 repositories · arXiv:1905.11286Syntology 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling 23 May 2019 · 4 repositories · arXiv:1905.09435Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Adaptively Truncating Backpropagation Through Time to Control Gradient Bias 17 May 2019 · 1 repository · arXiv:1905.07473Syntology official (archive's flag): 18 ran · 18 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 0 violated, 18 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 21 harvested samples)
-
AutoAssist: A Framework to Accelerate Training of Deep Neural Networks 8 May 2019 · 1 repository · arXiv:1905.03381Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Processing Megapixel Images with Deep Attention-Sampling Models 3 May 2019 · 2 repositories · arXiv:1905.03711Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares 29 Apr 2019 · 1 repository · arXiv:1904.12838Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
SWALP : Stochastic Weight Averaging in Low-Precision Training 26 Apr 2019 · 3 repositories · arXiv:1904.11943Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources 26 Apr 2019 · 2 repositories · arXiv:1904.12043Syntology 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 20 harvested samples) · 14 pointer-only (licence)
-
RepPoints: Point Set Representation for Object Detection 25 Apr 2019 · 6 repositories · arXiv:1904.11490Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution 10 Apr 2019 · 28 repositories · arXiv:1904.05049Syntology community repositories only · 24 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 13 where Syntology's instrument failed) · 10 unverified (of 34 harvested samples) · 9 pointer-only (licence)
-
Communication-efficient distributed SGD with Sketching 12 Mar 2019 · 2 repositories · arXiv:1903.04488Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation 10 Mar 2019 · 4 repositories · arXiv:1903.03936Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
MultiGrain: a unified image embedding for classes and instances 14 Feb 2019 · 3 repositories · arXiv:1902.05509Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
A Simple Baseline for Bayesian Uncertainty in Deep Learning 7 Feb 2019 · 8 repositories · arXiv:1902.02476Syntology official (archive's flag): 8 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 17 harvested samples) · 9 pointer-only (licence)
-
Asymmetric Valleys: Beyond Sharp and Flat Local Minima 2 Feb 2019 · 1 repository · arXiv:1902.00744Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Error Feedback Fixes SignSGD and other Gradient Compression Schemes 28 Jan 2019 · 2 repositories · arXiv:1901.09847Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network 28 Nov 2018 · 10 repositories · arXiv:1811.11431Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Stochastic Gradient Push for Distributed Deep Learning 27 Nov 2018 · 3 repositories · arXiv:1811.10792Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 2 pointer-only (licence)
-
Deep Frank-Wolfe For Neural Network Optimization 19 Nov 2018 · 1 repository · arXiv:1811.07591Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Quasi-hyperbolic momentum and Adam for deep learning 16 Oct 2018 · 2 repositories · arXiv:1810.06801Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
signSGD with Majority Vote is Communication Efficient And Fault Tolerant 11 Oct 2018 · 4 repositories · arXiv:1810.05291Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Preconditioner on Matrix Lie Group for SGD 26 Sep 2018 · 2 repositories · arXiv:1809.10232Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Sparsified SGD with Memory 20 Sep 2018 · 1 repository · arXiv:1809.07599Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Learning Rate Adaptation for Federated and Differentially Private Learning 11 Sep 2018 · 1 repository · arXiv:1809.03832Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Small steps and giant leaps: Minimal Newton solvers for Deep Learning 21 May 2018 · 6 repositories · arXiv:1805.08095Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Scalable Discrete-Time Survival Model for Neural Networks 2 May 2018 · 2 repositories · arXiv:1805.00917Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Averaging Weights Leads to Wider Optima and Better Generalization 14 Mar 2018 · 17 repositories · arXiv:1803.05407Syntology official (archive's flag): 2 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
Shampoo: Preconditioned Stochastic Tensor Optimization 26 Feb 2018 · 3 repositories · arXiv:1802.09568Syntology 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
signSGD: Compressed Optimisation for Non-Convex Problems 13 Feb 2018 · 6 repositories · arXiv:1802.04434Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Decoupled Weight Decay Regularization 14 Nov 2017 · 23 repositories · arXiv:1711.05101Syntology community repositories only · 18 ran (of which 6 constructed an object rather than computing a result; 18 with no instrument failure: 3 honoured, 0 violated, 15 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 23 harvested samples) · 5 pointer-only (licence)
-
Dual Path Networks 6 Jul 2017 · 18 repositories · arXiv:1707.01629Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour 8 Jun 2017 · 73 repositories · arXiv:1706.02677Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data 31 Mar 2017 · 3 repositories · arXiv:1703.11008Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Quasi-Recurrent Neural Networks 5 Nov 2016 · 7 repositories · arXiv:1611.01576Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures 22 Aug 2016 · 9 repositories · arXiv:1608.06037Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples)
-
Barzilai-Borwein Step Size for Stochastic Gradient Descent 13 May 2016 · 1 repository · arXiv:1605.04131Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
A Kronecker-factored approximate Fisher matrix for convolution layers 3 Feb 2016 · 4 repositories · arXiv:1602.01407Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Preconditioned Stochastic Gradient Descent 14 Dec 2015 · 2 repositories · arXiv:1512.04202Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Spatial Transformer Networks 5 Jun 2015 · 45 repositories · arXiv:1506.02025Syntology 21 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 1 honoured, 0 violated, 20 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 31 harvested samples)
-
On the Computational Efficiency of Training Neural Networks 5 Oct 2014 · 1 repository · arXiv:1410.1141Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent 28 Jun 2011 · 5 repositories · arXiv:1106.5730Syntology 16 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 24 harvested samples)