Methods › General › Optimization › Gradient Clipping › Papers, page 2

Gradient Clipping

Papers archive 2025-07-28

archive papers tagged: 167 · with a code link: 78 · where Syntology ran a sample: 28 (22 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (28 of 167 tagged: 22 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)

Page 2 of 2: papers 101 to 167 of 167, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Summarizing Videos using Concentrated Attention and Considering the Uniqueness and Diversity of the Video Frames
  29 Jun 2022 · 1 repository
• Normalized/Clipped SGD with Perturbation for Differentially Private Non-Convex Optimization
  27 Jun 2022 · 0 repositories · arXiv:2206.13033
• EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Engine
  21 Jun 2022 · 3 repositories · arXiv:2206.10558
  Syntology official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games
  18 Jun 2022 · 1 repository · arXiv:2206.09120
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Disparate Impact in Differential Privacy from Gradient Misalignment
  15 Jun 2022 · 1 repository · arXiv:2206.07737
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 20 harvested samples)
• Towards Scalable Hyperbolic Neural Networks using Taylor Series Approximations
  7 Jun 2022 · 0 repositories · arXiv:2206.03610
• Finite-Time Analysis of Entropy-Regularized Neural Natural Actor-Critic Algorithm
  2 Jun 2022 · 0 repositories · arXiv:2206.00833
• Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Condition
  1 Jun 2022 · 0 repositories · arXiv:2206.00508
• Efficient and Training-Free Control of Language Generation
  12 May 2022 · 0 repositories · arXiv:2205.06036
• A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks
  10 May 2022 · 1 repository · arXiv:2205.05040
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Semantic Exploration from Language Abstractions and Pretrained Representations
  8 Apr 2022 · 0 repositories · arXiv:2204.05080
• Mirror Descent Strikes Again: Optimal Stochastic Convex Optimization under Infinite Noise Variance
  23 Feb 2022 · 0 repositories · arXiv:2202.11632
• General Cyclical Training of Neural Networks
  17 Feb 2022 · 1 repository · arXiv:2202.08835
• Backpropagation Clipping for Deep Learning with Differential Privacy
  10 Feb 2022 · 1 repository · arXiv:2202.05089
• SparseFed: Mitigating Model Poisoning Attacks in Federated Learning with Sparsification
  12 Dec 2021 · 1 repository · arXiv:2112.06274
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Combining Global and Local Attention with Positional Encoding for Video Summarization
  1 Dec 2021 · 1 repository
• Improving Differentially Private SGD via Randomly Sparsified Gradients
  1 Dec 2021 · 1 repository · arXiv:2112.00845
• A Comparative Study of Transformers on Word Sense Disambiguation
  30 Nov 2021 · 0 repositories · arXiv:2111.15417
• Altering Backward Pass Gradients improves Convergence
  24 Nov 2021 · 0 repositories · arXiv:2111.12495
• Dynamic Differential-Privacy Preserving SGD
  30 Oct 2021 · 0 repositories · arXiv:2111.00173
• A Distributed Deep Reinforcement Learning Technique for Application Placement in Edge and Fog Computing Environments
  24 Oct 2021 · 0 repositories · arXiv:2110.12415
• A Loss Curvature Perspective on Training Instability in Deep Learning
  8 Oct 2021 · 0 repositories · arXiv:2110.04369
• A Loss Curvature Perspective on Training Instabilities of Deep Learning Models
  29 Sep 2021 · 0 repositories
• Losing Less: A Loss for Differentially Private Deep Learning
  29 Sep 2021 · 0 repositories
• TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation
  27 Sep 2021 · 3 repositories · arXiv:2109.13296
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• MACRPO: Multi-Agent Cooperative Recurrent Policy Optimization
  2 Sep 2021 · 1 repository · arXiv:2109.00882
• Semantic-embedded Unsupervised Spectral Reconstruction from Single RGB Images in the Wild
  15 Aug 2021 · 1 repository · arXiv:2108.06659
• NeuralDP Differentially private neural networks by design
  30 Jul 2021 · 0 repositories · arXiv:2107.14582
• Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy
  25 Jun 2021 · 0 repositories · arXiv:2106.13673
• Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
  4 Jun 2021 · 1 repository · arXiv:2106.02193
  Syntology official (archive's flag): 7 ran · 7 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 11 pointer-only (licence)
• Learning to Relate Depth and Semantics for Unsupervised Domain Adaptation
  17 May 2021 · 1 repository · arXiv:2105.07830
  Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• CTLR@WiC-TSV: Target Sense Verification using Marked Inputs andPre-trained Models
  30 Apr 2021 · 0 repositories
• Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness
  12 Feb 2021 · 0 repositories · arXiv:2102.06489
• High-Performance Large-Scale Image Recognition Without Normalization
  11 Feb 2021 · 20 repositories · arXiv:2102.06171
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Eliminating Sharp Minima from SGD with Truncated Heavy-tailed Noise
  8 Feb 2021 · 0 repositories · arXiv:2102.04297
• Robustness Threats of Differential Privacy
  14 Dec 2020 · 0 repositories · arXiv:2012.07828
• GOAT: GPU Outsourcing of Deep Learning Training With Asynchronous Probabilistic Integrity Verification Inside Trusted Execution Environment
  17 Oct 2020 · 0 repositories · arXiv:2010.08855
• Facilitate the Parametric Dimension Reduction by Gradient Clipping
  30 Sep 2020 · 0 repositories · arXiv:2009.14373
• Scaling up Differentially Private Deep Learning with Fast Per-Example Gradient Clipping
  7 Sep 2020 · 2 repositories · arXiv:2009.03106
• Training Deep Neural Networks Without Batch Normalization
  18 Aug 2020 · 0 repositories · arXiv:2008.07970
• AutoClip: Adaptive Gradient Clipping for Source Separation Networks
  25 Jul 2020 · 1 repository · arXiv:2007.14469
• Understanding Gradient Clipping in Private SGD: A Geometric Perspective
  27 Jun 2020 · 0 repositories · arXiv:2006.15429
• TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
  17 May 2020 · 1 repository · arXiv:2005.08314
• Differentially Private Generation of Small Images
  2 May 2020 · 1 repository · arXiv:2005.00783
• Can gradient clipping mitigate label noise?
  1 May 2020 · 1 repository
• Understanding Generalization in Recurrent Neural Networks
  1 May 2020 · 0 repositories
• Removing Disparate Impact of Differentially Private Stochastic Gradient Descent on Model Accuracy
  8 Mar 2020 · 0 repositories · arXiv:2003.03699
• A Self-Tuning Actor-Critic Algorithm
  28 Feb 2020 · 0 repositories · arXiv:2002.12928
• Towards Unified INT8 Training for Convolutional Neural Network
  29 Dec 2019 · 0 repositories · arXiv:1912.12607
• Why are Adaptive Methods Good for Attention Models?
  6 Dec 2019 · 0 repositories · arXiv:1912.03194
• IMPACT: Importance Weighted Asynchronous Architectures with Clipped Target Networks
  30 Nov 2019 · 0 repositories · arXiv:1912.00167
• Compressive Transformers for Long-Range Sequence Modelling
  13 Nov 2019 · 6 repositories · arXiv:1911.05507
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
• TorchBeast: A PyTorch Platform for Distributed RL
  8 Oct 2019 · 3 repositories · arXiv:1910.03552
  Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
• CTRL: A Conditional Transformer Language Model for Controllable Generation
  11 Sep 2019 · 8 repositories · arXiv:1909.05858
  Syntology 14 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 3 honoured, 1 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 14 harvested samples)
• Why gradient clipping accelerates training: A theoretical justification for adaptivity
  28 May 2019 · 1 repository · arXiv:1905.11881
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 3 pointer-only (licence)
• Differential Privacy Has Disparate Impact on Model Accuracy
  28 May 2019 · 1 repository · arXiv:1905.12101
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Towards Combining On-Off-Policy Methods for Real-World Applications
  24 Apr 2019 · 0 repositories · arXiv:1904.10642
• Feature Intertwiner for Object Detection
  28 Mar 2019 · 2 repositories · arXiv:1903.11851
• Classification of Medication-Related Tweets Using Stacked Bidirectional LSTMs with Context-Aware Attention
  1 Oct 2018 · 1 repository
• IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
  5 Feb 2018 · 24 repositories · arXiv:1802.01561
  Syntology community repositories only · 16 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 1 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 18 unverified (of 34 harvested samples) · 3 pointer-only (licence)
• Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning
  20 Oct 2017 · 7 repositories · arXiv:1710.07654
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Riemannian approach to batch normalization
  27 Sep 2017 · 1 repository · arXiv:1709.09603
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 15 harvested samples) · 1 pointer-only (licence)
• TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
  22 May 2017 · 1 repository · arXiv:1705.07878
• Language Modeling with Gated Convolutional Networks
  23 Dec 2016 · 11 repositories · arXiv:1612.08083
• Improving Neural Language Models with a Continuous Cache
  13 Dec 2016 · 14 repositories · arXiv:1612.04426
• A Comprehensive Study of Deep Bidirectional LSTM RNNs for Acoustic Modeling in Speech Recognition
  22 Jun 2016 · 0 repositories · arXiv:1606.06871
• Rethinking the Inception Architecture for Computer Vision
  2 Dec 2015 · 113 repositories · arXiv:1512.00567
  Syntology 20 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 26 harvested samples) · 5 pointer-only (licence)