Browse State-of-the-Art › Second-order methods › Papers, page 2

Second-order methods

Papers archive 2025-07-28

archive papers tagged: 181 · with a code link: 52 · where Syntology ran a sample: 12 (11 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (12 of 181 tagged: 11 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 2 of 2: papers 101 to 181 of 181, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• On the efficiency of Stochastic Quasi-Newton Methods for Deep Learning
  18 May 2022 0 repositories listed
• A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization
  19 Apr 2022 0 repositories listed
• Accelerating Stochastic Probabilistic Inference
  15 Mar 2022 0 repositories listed
• Amortized Proximal Optimization
  28 Feb 2022 0 repositories listed
• A Mini-Block Fisher Method for Deep Neural Networks
  8 Feb 2022 0 repositories listed
• Accelerated Projected Gradient Method for the Optimization of Cell-Free Massive MIMO Downlink
  12 Jan 2022 0 repositories listed
• SCORE: Approximating Curvature Information under Self-Concordant Regularization
  14 Dec 2021 0 repositories listed
• Newton methods based convolution neural networks using parallel processing
  2 Dec 2021 0 repositories listed
• Basis Matters: Better Communication-Efficient Second Order Methods for Federated Learning
  2 Nov 2021 0 repositories listed
• Provable Regret Bounds for Deep Online Learning and Control
  15 Oct 2021 0 repositories listed
• KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey
  5 Oct 2021 0 repositories listed
• SLIM-QN: A Stochastic, Light, Momentumized Quasi-Newton Optimizer for Deep Neural Networks
  29 Sep 2021 0 repositories listed
• Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
  11 Sep 2021 0 repositories listed
• Structured second-order methods via natural gradient descent
  22 Jul 2021 0 repositories listed
• Bilinear Parameterization for Non-Separable Singular Value Penalties
  19 Jun 2021 0 repositories listed
• FedNL: Making Newton-Type Methods Applicable to Federated Learning
  5 Jun 2021 0 repositories listed
• Exact Stochastic Second Order Deep Learning
  8 Apr 2021 0 repositories listed
• Quasi-Newton Quasi-Monte Carlo for variational Bayes
  7 Apr 2021 0 repositories listed
• Research of Damped Newton Stochastic Gradient Descent Method for Neural Network Training
  31 Mar 2021 0 repositories listed
• A Distributed Optimisation Framework Combining Natural Gradient with Hessian-Free for Discriminative Sequence Training
  12 Mar 2021 0 repositories listed
• Learning-Augmented Sketches for Hessians
  24 Feb 2021 0 repositories listed
• Distributed Second Order Methods with Fast Rates and Compressed Communication
  14 Feb 2021 0 repositories listed
• Kronecker-factored Quasi-Newton Methods for Deep Learning
  12 Feb 2021 0 repositories listed
• A Chaos Theory Approach to Understand Neural Network Optimization
  1 Jan 2021 0 repositories listed
• Adaptive Single-Pass Stochastic Gradient Descent in Input Sparsity Time
  1 Jan 2021 0 repositories listed
• Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
  7 Dec 2020 0 repositories listed
• Second-order Neural Network Training Using Complex-step Directional Derivative
  15 Sep 2020 0 repositories listed
• Utility Maximization for Large-Scale Cell-Free Massive MIMO Downlink
  15 Sep 2020 0 repositories listed
• Debiasing Distributed Second Order Optimization with Surrogate Sketching and Scaled Regularization
  2 Jul 2020 0 repositories listed
• Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations
  24 Jun 2020 0 repositories listed
• When Does Preconditioning Help or Hurt Generalization?
  18 Jun 2020 0 repositories listed
• A block coordinate descent optimizer for classification problems exploiting convexity
  17 Jun 2020 0 repositories listed
• Enhance Curvature Information by Structured Stochastic Quasi-Newton Methods
  17 Jun 2020 0 repositories listed
• SONIA: A Symmetric Blockwise Truncated Optimization Algorithm
  6 Jun 2020 0 repositories listed
• Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses
  23 Mar 2020 0 repositories listed
• Stochastic Subspace Cubic Newton Method
  21 Feb 2020 0 repositories listed
• DDPNOpt: Differential Dynamic Programming Neural Optimizer
  20 Feb 2020 0 repositories listed
• Curvature-corrected learning dynamics in deep neural networks
  1 Jan 2020 0 repositories listed
• Hierarchical model-based policy optimization: from actions to action sequences and back
  28 Nov 2019 0 repositories listed
• Implementation of a modified Nesterov's Accelerated quasi-Newton Method on Tensorflow
  21 Oct 2019 0 repositories listed
• EXACT ANALYSIS OF CURVATURE CORRECTED LEARNING DYNAMICS IN DEEP LINEAR NETWORKS
  25 Sep 2019 0 repositories listed
• Quasi-Newton Optimization Methods For Deep Learning Applications
  4 Sep 2019 0 repositories listed
• Practical Newton-Type Distributed Learning using Gradient Based Approximations
  22 Jul 2019 0 repositories listed
• Meta-descent for Online, Continual Prediction
  17 Jul 2019 0 repositories listed
• Gram-Gauss-Newton Method: Learning Overparameterized Neural Networks for Regression Problems
  28 May 2019 0 repositories listed
• Bilinear Parameterization For Differentiable Rank-Regularization
  27 Nov 2018 0 repositories listed
• Deep Reinforcement Learning via L-BFGS Optimization
  6 Nov 2018 0 repositories listed
• Stochastic Second-order Methods for Non-convex Optimization with Inexact Hessian and Gradient
  26 Sep 2018 0 repositories listed
• A Distributed Second-Order Algorithm You Can Trust
  20 Jun 2018 0 repositories listed
• GPU Accelerated Sub-Sampled Newton's Method
  26 Feb 2018 0 repositories listed
• The Many Faces of Exponential Weights in Online Learning
  21 Feb 2018 0 repositories listed
• A comparison of second-order methods for deep convolutional neural networks
  1 Jan 2018 0 repositories listed
• Block-diagonal Hessian-free Optimization for Training Neural Networks
  20 Dec 2017 0 repositories listed
• Efficient Second-Order Online Kernel Learning with Adaptive Embedding
  1 Dec 2017 0 repositories listed
• Nesterov's Acceleration For Approximate Newton
  17 Oct 2017 0 repositories listed
• Accelerating SGD for Distributed Deep-Learning Using Approximated Hessian Matrix
  15 Sep 2017 0 repositories listed
• A Generic Approach for Escaping Saddle points
  5 Sep 2017 0 repositories listed
• First and Second Order Methods for Online Convolutional Dictionary Learning
  31 Aug 2017 0 repositories listed
• Second-Order Optimization for Non-Convex Machine Learning: An Empirical Study
  25 Aug 2017 0 repositories listed
• Approximate Newton Methods and Their Local Convergence
  1 Aug 2017 0 repositories listed
• Second-Order Kernel Online Convex Optimization with Adaptive Sketching
  15 Jun 2017 0 repositories listed
• Large Scale Empirical Risk Minimization via Truncated Adaptive Newton Method
  22 May 2017 0 repositories listed
• Nestrov's Acceleration For Second Order Method
  19 May 2017 0 repositories listed
• Biologically inspired protection of deep networks from adversarial attacks
  27 Mar 2017 0 repositories listed
• Highly Efficient Hierarchical Online Nonlinear Regression Using Second Order Methods
  18 Jan 2017 0 repositories listed
• Oracle Complexity of Second-Order Methods for Finite-Sum Problems
  15 Nov 2016 0 repositories listed
• Stochastic Heavy Ball
  14 Sep 2016 0 repositories listed
• Sub-sampled Newton Methods with Non-uniform Sampling
  2 Jul 2016 0 repositories listed
• A Decentralized Quasi-Newton Method for Dual Formulations of Consensus Optimization
  23 Mar 2016 0 repositories listed
• Stochastic Quasi-Newton Langevin Monte Carlo
  10 Feb 2016 0 repositories listed
• Sub-Sampled Newton Methods II: Local Convergence Rates
  18 Jan 2016 0 repositories listed
• Newton-Stein Method: A Second Order Method for GLMs via Stein's Lemma
  1 Dec 2015 0 repositories listed
• Alternating direction method of multipliers for regularized multiclass support vector machines
  30 Nov 2015 0 repositories listed
• Newton-Stein Method: An optimization method for GLMs via Stein's Lemma
  28 Nov 2015 0 repositories listed
• Saddle-free Hessian-free Optimization
  30 May 2015 0 repositories listed
• A Flexible Tensor Block Coordinate Ascent Scheme for Hypergraph Matching
  29 Apr 2015 0 repositories listed
• QUIC & DIRTY: A Quadratic Approximation Approach for Dirty Statistical Models
  1 Dec 2014 0 repositories listed
• A scaled gradient projection method for Bayesian learning in dynamical systems
  25 Jun 2014 0 repositories listed
• RES: Regularized Stochastic BFGS Algorithm
  29 Jan 2014 0 repositories listed
• On the importance of initialization and momentum in deep learning
  26 May 2013 0 repositories listed
• Second Order Bilinear Discriminant Analysis for single trial EEG analysis
  1 Dec 2007 0 repositories listed