Methods › General › Regularization › Zoneout
Zoneout
Introduced by David Krueger et al. in Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Zoneout is a method for regularizing RNNs. At each timestep, zoneout stochastically forces some hidden units to maintain their previous values. Like dropout, zoneout uses random noise to train a pseudo-ensemble, improving generalization. But by preserving instead of dropping hidden units, gradient information and state information are more readily propagated through time, as in feedforward stochastic depth networks.
Papers archive 2025-07-28
29 shown of 29, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems 4 Sep 2024 · 0 repositories · arXiv:2409.02517
-
Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning 22 May 2024 · 0 repositories · arXiv:2405.13672
-
An overview of text-to-speech systems and media applications 22 Oct 2023 · 0 repositories · arXiv:2310.14301
-
Energy-Based Models For Speech Synthesis 19 Oct 2023 · 0 repositories · arXiv:2310.12765
-
Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration 25 May 2023 · 1 repository · arXiv:2305.15749
-
ArmanTTS single-speaker Persian dataset 7 Apr 2023 · 0 repositories · arXiv:2304.03585
-
Facial Landmark Predictions with Applications to Metaverse 29 Sep 2022 · 1 repository · arXiv:2209.14698
-
ZoDIAC: Zoneout Dropout Injection Attention Calculation 28 Jun 2022 · 1 repository · arXiv:2206.14263
-
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention 25 Jan 2022 · 0 repositories · arXiv:2201.10375
-
ITAcotron 2: Transfering English Speech Synthesis Architectures and Speech Features to Italian 1 Nov 2021 · 1 repository
-
Neural Sequence-to-Sequence Speech Synthesis Using a Hidden Semi-Markov Model Based Structured Attention Mechanism 31 Aug 2021 · 0 repositories · arXiv:2108.13985
-
Neural HMMs are all you need (for high-quality attention-free TTS) 30 Aug 2021 · 2 repositories · arXiv:2108.13320
-
Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesis 15 Jun 2021 · 0 repositories · arXiv:2106.08352
-
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention 12 Feb 2021 · 0 repositories · arXiv:2102.06431
-
Bidirectional Variational Inference for Non-Autoregressive Text-to-Speech 1 Jan 2021 · 1 repository
-
Using previous acoustic context to improve Text-to-Speech synthesis 7 Dec 2020 · 0 repositories · arXiv:2012.03763
-
Learning Speaker Embedding from Text-to-Speech 21 Oct 2020 · 1 repository · arXiv:2010.11221
-
Non-Attentive Tacotron: Robust and Controllable Neural TTS Synthesis Including Unsupervised Duration Modeling 8 Oct 2020 · 6 repositories · arXiv:2010.04301Syntology ran 0 of 7 samples · 7 unverified
-
SpeedySpeech: Efficient Neural Speech Synthesis 9 Aug 2020 · 3 repositories · arXiv:2008.03802Syntology ran 1 of 1 samples · 0 unverified
-
One Model, Many Languages: Meta-learning for Multilingual Text-to-Speech 3 Aug 2020 · 1 repository · arXiv:2008.00768
-
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis 12 May 2020 · 3 repositories · arXiv:2005.05957Syntology ran 4 of 19 samples · 15 unverified
-
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis 6 Feb 2020 · 0 repositories · arXiv:2002.03785
-
Probing the phonetic and phonological knowledge of tones in Mandarin TTS models 23 Dec 2019 · 1 repository · arXiv:1912.10915
-
Mellotron: Multispeaker expressive voice synthesis by conditioning on rhythm, pitch and global style tokens 26 Oct 2019 · 5 repositories · arXiv:1910.11997
-
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions 16 Dec 2017 · 33 repositories · arXiv:1712.05884Syntology ran 7 of 7 samples · 0 unverified · 2 pointer-only (licence)
-
Quasi-Recurrent Neural Networks 5 Nov 2016 · 7 repositories · arXiv:1611.01576Syntology ran 0 of 1 samples · 1 unverified
-
Surprisal-Driven Zoneout 24 Oct 2016 · 0 repositories · arXiv:1610.07675
-
Pointer Sentinel Mixture Models 26 Sep 2016 · 10 repositories · arXiv:1609.07843Syntology ran 2 of 9 samples · 7 unverified · 1 pointer-only (licence)
-
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations 3 Jun 2016 · 10 repositories · arXiv:1606.01305Syntology ran 0 of 3 samples · 3 unverified
Tasks archive 2025-07-28
20 shown of 38 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections