Methods › General › Miscellaneous Components › Highway Layer
Highway Layer
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
A Highway Layer contains an information highway to other layers that helps with information flow. It is characterised by the use of a gating unit to help this information flow.
A plain feedforward neural network typically consists of L layers where the $l$th layer (l ∈{1, 2, …, L}) applies a nonlinear transform H (parameterized by W_(H,l)) on its input xₗ to produce its output yₗ. Thus, x₁ is the input to the network and y_L is the network’s output. Omitting the layer index and biases for clarity,
y = H(x,W_H)
H is usually an affine transform followed by a non-linear activation function, but in general it may take other forms.
For a highway network, we additionally define two nonlinear transforms T(x,W_T) and C(x,W_C) such that:
y = H(x,W_H)·T(x,W_T) + x·C(x,W_C)
We refer to T as the transform gate and C as the carry gate, since they express how much of the output is produced by transforming the input and carrying it, respectively. In the original paper, the authors set C = 1 − T, giving:
y = H(x,W_H)·T(x,W_T) + x·(1-T(x,W_T))
The authors set:
T(x) = σ(W_Tᵀx + b_T)
Image: Sik-Ho Tsang
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Highway Transformer; Highway backpropagation; Highway Error Propagation (HEP).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 108 · with a code link: 43 · where Syntology ran a sample: 14 (10 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (14 of 108 tagged: 10 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 108, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Coordinated Ramp Metering Control based on Scalable Nonlinear Traffic Dynamics Model Discovery in a Large Network 9 Mar 2025 · 0 repositories · arXiv:2503.06767
-
Robust and Unbounded Length Generalization in Autoregressive Transformer-Based Text-to-Speech 29 Oct 2024 · 1 repository · arXiv:2410.22179
-
Enhancing Kurdish Text-to-Speech with Native Corpus Training: A High-Quality WaveGlow Vocoder Approach 10 Sep 2024 · 0 repositories · arXiv:2409.13734
-
Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems 4 Sep 2024 · 0 repositories · arXiv:2409.02517
-
Expanding the Scope: Inductive Knowledge Graph Reasoning with Multi-Starting Progressive Propagation 15 Jul 2024 · 1 repository · arXiv:2407.10430
-
Highway Networks for Improved Surface Reconstruction: The Role of Residuals and Weight Updates 11 Jul 2024 · 1 repository · arXiv:2407.08134
-
Stable Weight Updating: A Key to Reliable PDE Solutions Using Deep Learning 10 Jul 2024 · 0 repositories · arXiv:2407.07375
-
Modeling of spatially embedded networks via regional spatial graph convolutional networks 20 Jun 2024 · 1 repository
-
Informed along the road: roadway capacity driven graph convolution network for network-wide traffic prediction 18 Jun 2024 · 0 repositories · arXiv:2406.13057
-
Traffic Prediction considering Multiple Levels of Spatial-temporal Information: A Multi-scale Graph Wavelet-based Approach 18 Jun 2024 · 0 repositories · arXiv:2406.13038
-
Leveraging the Interplay Between Syntactic and Acoustic Cues for Optimizing Korean TTS Pause Formation 3 Apr 2024 · 0 repositories · arXiv:2404.02592
-
Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matching 1 Mar 2024 · 1 repository · arXiv:2403.00486Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 5 pointer-only (licence)
-
On the Effectiveness of Unlearning in Session-Based Recommendation 22 Dec 2023 · 1 repository · arXiv:2312.14447Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
A Data-Driven Integrated Framework for Fast-Charging Facility Planning using Multi-Period Bi-Objective Optimization 21 Nov 2023 · 0 repositories · arXiv:2311.12700
-
Reinforcement Learning with Model Predictive Control for Highway Ramp Metering 15 Nov 2023 · 1 repository · arXiv:2311.08820
-
Distil the informative essence of loop detector data set: Is network-level traffic forecasting hungry for more data? 31 Oct 2023 · 1 repository · arXiv:2310.20366
-
Power-Enhanced Residual Network for Function Approximation and Physics-Informed Inverse Problems 24 Oct 2023 · 1 repository · arXiv:2310.15690
-
An overview of text-to-speech systems and media applications 22 Oct 2023 · 0 repositories · arXiv:2310.14301
-
Energy-Based Models For Speech Synthesis 19 Oct 2023 · 0 repositories · arXiv:2310.12765
-
Facilitating Battery Swapping Services for Freight Trucks with Spatial-Temporal Demand Prediction 1 Oct 2023 · 0 repositories · arXiv:2310.04440
-
The DeepZen Speech Synthesis System for Blizzard Challenge 2023 30 Aug 2023 · 0 repositories · arXiv:2308.15945
-
Machine learning for option pricing: an empirical investigation of network architectures 14 Jul 2023 · 0 repositories · arXiv:2307.07657
-
Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration 25 May 2023 · 1 repository · arXiv:2305.15749
-
Neural Machine Translation Models with Attention-Based Dropout Layer 1 May 2023 · 1 repository
-
A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers 16 Apr 2023 · 0 repositories · arXiv:2304.07842
-
ArmanTTS single-speaker Persian dataset 7 Apr 2023 · 0 repositories · arXiv:2304.03585
-
SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy 1 Jan 2023 · 1 repository
-
Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language 16 Dec 2022 · 0 repositories · arXiv:2212.08321
-
Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features 1 Nov 2022 · 0 repositories · arXiv:2211.00342
-
Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation 31 Oct 2022 · 0 repositories · arXiv:2210.17264
-
Towards Developing State-of-the-Art TTS Synthesisers for 13 Indian Languages with Signal Processing aided Alignments 31 Oct 2022 · 0 repositories · arXiv:2210.17153
-
Efficiently Trained Low-Resource Mongolian Text-to-Speech System Based On FullConv-TTS 24 Oct 2022 · 0 repositories · arXiv:2211.01948
-
Facial Landmark Predictions with Applications to Metaverse 29 Sep 2022 · 1 repository · arXiv:2209.14698
-
Self-supervised learning for robust voice cloning 7 Apr 2022 · 0 repositories · arXiv:2204.03421
-
A Robust Approach for the Decomposition of High-Energy-Consuming Industrial Loads with Deep Learning 11 Mar 2022 · 0 repositories · arXiv:2203.07075
-
Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesis 16 Feb 2022 · 0 repositories · arXiv:2202.07907
-
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention 25 Jan 2022 · 0 repositories · arXiv:2201.10375
-
Word-Level Style Control for Expressive, Non-attentive Speech Synthesis 19 Nov 2021 · 0 repositories · arXiv:2111.10173
-
High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency 17 Nov 2021 · 0 repositories · arXiv:2111.09052
-
On-device neural speech synthesis 17 Sep 2021 · 0 repositories · arXiv:2109.08710
-
Neural Sequence-to-Sequence Speech Synthesis Using a Hidden Semi-Markov Model Based Structured Attention Mechanism 31 Aug 2021 · 0 repositories · arXiv:2108.13985
-
Neural HMMs are all you need (for high-quality attention-free TTS) 30 Aug 2021 · 2 repositories · arXiv:2108.13320
-
One TTS Alignment To Rule Them All 23 Aug 2021 · 3 repositories · arXiv:2108.10447
-
MOHAQ: Multi-Objective Hardware-Aware Quantization of Recurrent Neural Networks 2 Aug 2021 · 0 repositories · arXiv:2108.01192
-
Using Deep Learning Techniques and Inferential Speech Statistics for AI Synthesised Speech Recognition 23 Jul 2021 · 0 repositories · arXiv:2107.11412
-
AI based Presentation Creator With Customized Audio Content Delivery 27 Jun 2021 · 0 repositories · arXiv:2106.14213
-
Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesis 15 Jun 2021 · 0 repositories · arXiv:2106.08352
-
Exploring emotional prototypes in a high dimensional TTS latent space 5 May 2021 · 0 repositories · arXiv:2105.01891
-
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention 12 Feb 2021 · 0 repositories · arXiv:2102.06431
-
Whispered and Lombard Neural Speech Synthesis 13 Jan 2021 · 0 repositories · arXiv:2101.05313
-
Bidirectional Variational Inference for Non-Autoregressive Text-to-Speech 1 Jan 2021 · 1 repository
-
Parallel WaveNet conditioned on VAE latent vectors 17 Dec 2020 · 0 repositories · arXiv:2012.09703
-
Using previous acoustic context to improve Text-to-Speech synthesis 7 Dec 2020 · 0 repositories · arXiv:2012.03763
-
Using IPA-Based Tacotron for Data Efficient Cross-Lingual Speaker Adaptation and Pronunciation Enhancement 12 Nov 2020 · 0 repositories · arXiv:2011.06392
-
Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesis 6 Nov 2020 · 1 repository · arXiv:2011.03568
-
DeviceTTS: A Small-Footprint, Fast, Stable Network for On-Device Text-to-Speech 29 Oct 2020 · 0 repositories · arXiv:2010.15311
-
An Investigation of the Relation Between Grapheme Embeddings and Pronunciation for Tacotron-based Systems 21 Oct 2020 · 0 repositories · arXiv:2010.10694
-
Learning Speaker Embedding from Text-to-Speech 21 Oct 2020 · 1 repository · arXiv:2010.11221
-
Non-Attentive Tacotron: Robust and Controllable Neural TTS Synthesis Including Unsupervised Duration Modeling 8 Oct 2020 · 6 repositories · arXiv:2010.04301Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Intelligent Reflecting Surface Enhanced Indoor Robot Path Planning: A Radio Map based Approach 27 Sep 2020 · 0 repositories · arXiv:2009.12804
-
Controllable neural text-to-speech synthesis using intuitive prosodic features 14 Sep 2020 · 0 repositories · arXiv:2009.06775
-
Visual-speech Synthesis of Exaggerated Corrective Feedback 12 Sep 2020 · 0 repositories · arXiv:2009.05748
-
Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style Conversion 13 Aug 2020 · 1 repository · arXiv:2008.05809Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS 11 Aug 2020 · 0 repositories · arXiv:2008.05284
-
SpeedySpeech: Efficient Neural Speech Synthesis 9 Aug 2020 · 3 repositories · arXiv:2008.03802Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
One Model, Many Languages: Meta-learning for Multilingual Text-to-Speech 3 Aug 2020 · 1 repository · arXiv:2008.00768
-
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition 21 May 2020 · 0 repositories · arXiv:2005.10469
-
Multistream CNN for Robust Acoustic Modeling 21 May 2020 · 0 repositories · arXiv:2005.10470
-
Investigation of learning abilities on linguistic features in sequence-to-sequence text-to-speech synthesis 20 May 2020 · 0 repositories · arXiv:2005.10390
-
TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese 11 May 2020 · 1 repository · arXiv:2005.05144
-
Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit 22 Apr 2020 · 0 repositories · arXiv:2004.10823
-
WaveCRN: An Efficient Convolutional Recurrent Neural Network for End-to-end Speech Enhancement 6 Apr 2020 · 5 repositories · arXiv:2004.04098
-
Recurrent Highway Networks with Grouped Auxiliary Memory 13 Dec 2019 · 4 repositories
-
Economy Statistical Recurrent Units For Inferring Nonlinear Granger Causality 22 Nov 2019 · 1 repository · arXiv:1911.09879Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis 11 Nov 2019 · 0 repositories · arXiv:1911.04111
-
Speech Recognition with Augmented Synthesized Speech 25 Sep 2019 · 0 repositories · arXiv:1909.11699
-
Graph-Partitioning-Based Diffusion Convolutional Recurrent Neural Network for Large-Scale Traffic Forecasting 24 Sep 2019 · 2 repositories · arXiv:1909.11197
-
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning 9 Jul 2019 · 4 repositories · arXiv:1907.04448Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 7 pointer-only (licence)
-
A New GAN-based End-to-End TTS Training Algorithm 9 Apr 2019 · 0 repositories · arXiv:1904.04775
-
Taco-VC: A Single Speaker Tacotron based Voice Conversion with Limited Data 6 Apr 2019 · 0 repositories · arXiv:1904.03522
-
Multi-reference Tacotron by Intercross Training for Style Disentangling,Transfer and Control in Speech Synthesis 4 Apr 2019 · 0 repositories · arXiv:1904.02373
-
Joint training framework for text-to-speech and voice conversion using multi-source Tacotron and WaveNet 29 Mar 2019 · 0 repositories · arXiv:1903.12389
-
FastFusionNet: New State-of-the-Art for DAWNBench SQuAD 28 Feb 2019 · 2 repositories · arXiv:1902.11291
-
Analysing Dropout and Compounding Errors in Neural Language Models 2 Nov 2018 · 0 repositories · arXiv:1811.00998
-
Investigation of enhanced Tacotron text-to-speech synthesis systems with self-attention for pitch accent language 29 Oct 2018 · 1 repository · arXiv:1810.11960
-
Learning User Preferences and Understanding Calendar Contexts for Event Scheduling 5 Sep 2018 · 1 repository · arXiv:1809.01316
-
Semi-Supervised Training for Improving Data Efficiency in End-to-End Speech Synthesis 30 Aug 2018 · 0 repositories · arXiv:1808.10128
-
Predicting Expressive Speaking Style From Text In End-To-End Speech Synthesis 4 Aug 2018 · 0 repositories · arXiv:1808.01410
-
A Multi-Attention based Neural Network with External Knowledge for Story Ending Predicting Task 1 Aug 2018 · 0 repositories
-
Learning to Generate Word Representations using Subword Information 1 Aug 2018 · 0 repositories
-
Voice Imitating Text-to-Speech Neural Networks 4 Jun 2018 · 0 repositories
-
Hierarchical Attention-Based Recurrent Highway Networks for Time Series Prediction 2 Jun 2018 · 2 repositories · arXiv:1806.00685
-
Semi-supervised User Geolocation via Graph Convolutional Networks 22 Apr 2018 · 1 repository · arXiv:1804.08049Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Single Stream Parallelization of Recurrent Neural Networks for Low Power and Fast Inference 30 Mar 2018 · 0 repositories · arXiv:1803.11389
-
Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotron 24 Mar 2018 · 3 repositories · arXiv:1803.09047Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis 23 Mar 2018 · 11 repositories · arXiv:1803.09017Syntology 19 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 21 harvested samples) · 9 pointer-only (licence)
-
LCANet: End-to-End Lipreading with Cascaded Attention-CTC 13 Mar 2018 · 0 repositories · arXiv:1803.04988
-
Training RNNs as Fast as CNNs 1 Jan 2018 · 2 repositories
-
Emotional End-to-End Neural Speech Synthesizer 15 Nov 2017 · 1 repository · arXiv:1711.05447
-
Uncovering Latent Style Factors for Expressive Speech Synthesis 1 Nov 2017 · 0 repositories · arXiv:1711.00520
Tasks archive 2025-07-28
20 shown of 96 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections