Methods › Audio › Text-to-Speech Models › FastPitch
FastPitch
Introduced by Adrian Łańcucki in FastPitch: Parallel Text-to-speech with Pitch Prediction
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
FastPitch is a fully-parallel text-to-speech model based on FastSpeech, conditioned on fundamental frequency contours. The architecture of FastPitch is shown in the Figure. It is based on FastSpeech and composed mainly of two feed-forward Transformer (FFTr) stacks. The first one operates in the resolution of input tokens, the second one in the resolution of the output frames. Let x=(x₁, …, xₙ) be the sequence of input lexical units, and 𝐲=(y₁, …, yₜ) be the sequence of target mel-scale spectrogram frames. The first FFTr stack produces the hidden representation 𝐡=FFTr(𝐱). The hidden representation h is used to make predictions about the duration and average pitch of every character with a 1-D CNN
𝐝̂= DurationPredictor (𝐡), 𝐩̂=PitchPredictor(𝐡)
where 𝐝̂ ∈ℕⁿ and 𝐩̂ ∈ℝⁿ. Next, the pitch is projected to match the dimensionality of the hidden representation h ∈ ℝ^(n ×d) and added to 𝐡. The resulting sum 𝐠 is discretely upsampled and passed to the output FFTr, which produces the output mel-spectrogram sequence
𝐠=𝐡+PitchEmbedding(𝐩)
𝐲̂=FFTr([g₁, …, g₁_(d₁), …gₙ, …, gₙ_(dₙ)])
Ground truth 𝐩 and 𝐝 are used during training, and predicted 𝐩̂ and 𝐝̂ are used during inference. The model optimizes mean-squared error (MSE) between the predicted and ground-truth modalities
ℒ=𝐲̂-𝐲₂²+α𝐩̂-𝐩₂²+γ𝐝̂-𝐝₂²
Papers archive 2025-07-28
9 shown of 9, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Efficient training strategies for natural sounding speech synthesis and speaker adaptation based on FastPitch 9 Oct 2024 · 0 repositories · arXiv:2410.06787
-
Attempt Towards Stress Transfer in Speech-to-Speech Machine Translation 7 Mar 2024 · 0 repositories · arXiv:2403.04178
-
Incremental FastPitch: Chunk-based High Quality Text to Speech 3 Jan 2024 · 0 repositories · arXiv:2401.01755
-
Improved Child Text-to-Speech Synthesis through Fastpitch-based Transfer Learning 7 Nov 2023 · 1 repository · arXiv:2311.04313
-
Towards Building Text-To-Speech Systems for the Next Billion Users 17 Nov 2022 · 2 repositories · arXiv:2211.09536Syntology ran 0 of 1 samples · 1 unverified
-
Enhancement of Pitch Controllability using Timbre-Preserving Pitch Augmentation in FastPitch 12 Apr 2022 · 0 repositories · arXiv:2204.05753
-
Generative Modeling for Low Dimensional Speech Attributes with Neural Spline Flows 3 Mar 2022 · 1 repository · arXiv:2203.01786
-
Exploring Timbre Disentanglement in Non-Autoregressive Cross-Lingual Text-to-Speech 14 Oct 2021 · 0 repositories · arXiv:2110.07192
-
FastPitch: Parallel Text-to-speech with Pitch Prediction 11 Jun 2020 · 6 repositories · arXiv:2006.06873Syntology ran 4 of 9 samples · 5 unverified
Tasks archive 2025-07-28
20 shown of 28 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections