{"url":"/method/multiple-random-window-discriminator","slug":"multiple-random-window-discriminator","name":"Multiple Random Window Discriminator","full_name":"Multiple Random Window Discriminator","full_name_withheld":false,"description_markdown":"**Multiple Random Window Discriminator** is a discriminator used for the [GAN-TTS](https://paperswithcode.com/method/gan-tts) text-to-speech architecture. These discriminators operate on randomly sub-sampled fragments of the real or generated samples. The ensemble allows for the evaluation of audio in different complementary ways, and is obtained by taking\r\na Cartesian product of two parameter spaces: (i) the size of the random windows fed into the discriminator; (ii) whether a discriminator is conditioned on linguistic and pitch features. For example,\r\nin the authors' best-performing model, they consider five window sizes (240, 480, 960, 1920, 3600 samples), which yields 10 discriminators in total. \r\n\r\nUsing random windows of different size, rather than the full generated sample, has a data augmentation effect and also reduces the computational complexity of RWDs. In the first layer of each discriminator, the MRWD reshapes (downsamples) the input raw waveform to a constant\r\ntemporal dimension $\\omega = 240$ by moving consecutive blocks of samples into the channel dimension, i.e. from $\\left[\\omega\\_{k}, 1\\right]$ to $\\left[\\omega, k\\right]$, where $k$ is the downsampling factor (e.g. $k = 8$ for input window size $1920$). This way, all the RWDs have the same architecture and similar computational complexity despite different window sizes. \r\n\r\nThe conditional discriminators have access to linguistic and pitch features, and can measure whether\r\nthe generated audio matches the input conditioning. This means that random windows in conditional\r\ndiscriminators need to be aligned with the conditioning frequency to preserve the correspondence\r\nbetween the waveform and linguistic features within the sampled window. This limits the valid sampling to that of the frequency of the conditioning signal (200Hz, or every 5ms). The unconditional\r\ndiscriminators, on the contrary, only evaluate whether the generated audio sounds realistic regardless\r\nof the conditioning. The random windows for these discriminators are sampled without constraints\r\nat full 24kHz frequency, which further increases the amount of training data. \r\n\r\nFor the architecture, the discriminators consists of blocks (DBlocks) that are similar to the [GBlocks](https://paperswithcode.com/method/gblock) used in the generator, but without batch normalisation. Unconditional RWDs are composed entirely of DBlocks. In conditional RWDs, the input waveform is gradually downsampled by DBlocks, until the temporal dimension of the activation is equal to that of the conditioning, at which point a conditional [DBlock](https://paperswithcode.com/method/dblock) is used. This joint information is then passed to the remaining DBlocks, whose final output is average-pooled to obtain a scalar. The dilation factors in the DBlocks’ convolutions follow the pattern 1, 2, 1, 2 – unlike the generator, the discriminator operates on a relatively small window, and the authors did not observe any benefit from using larger dilation factors.","description_state":"present","introduced_year":null,"introduced_by":{"title":"High Fidelity Speech Synthesis with Adversarial Networks","paper":"/paper/high-fidelity-speech-synthesis-with-1","first_author":"Mikołaj Bińkowski","n_authors":8,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/high-fidelity-speech-synthesis-with-1"},"source":{"url":"https://arxiv.org/abs/1909.11646v2","title":"High Fidelity Speech Synthesis with Adversarial Networks","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/yanggeng1995/GAN-TTS/blob/75d70dec97ba11dbe5ee3e2e9ebfbdd10bd52389/models/discriminator.py#L5","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Discriminators","url":"/methods/category/discriminators","pwc_aliases":[]}],"n_papers_tagged":2,"archive_num_papers":2,"papers_newest_first":[{"paper":"/paper/a-spectral-energy-distance-for-parallel","title":"A Spectral Energy Distance for Parallel Speech Synthesis","date":"2020-08-03","arxiv_id":"2008.01160","n_code_links":2,"syntology":{"ran":0,"of":3,"unverified":3,"pointer_only":0}},{"paper":"/paper/high-fidelity-speech-synthesis-with-1","title":"High Fidelity Speech Synthesis with Adversarial Networks","date":"2019-09-25","arxiv_id":"1909.11646","n_code_links":3,"syntology":{"ran":2,"of":5,"unverified":3,"pointer_only":4}}],"papers_shown":2,"tasks":[{"task":"/task/speech-synthesis","name":"Speech Synthesis","papers":2},{"task":null,"name":"Generative Adversarial Network","papers":1},{"task":"/task/text-to-speech","name":"Text to Speech","papers":1},{"task":"/task/high","name":"Vocal Bursts Intensity Prediction","papers":1},{"task":"/task/scoring-rule","name":"scoring rule","papers":1},{"task":"/task/text-to-speech-1","name":"text-to-speech","papers":1}],"tasks_shown":6,"n_tasks":6,"usage_by_year":[{"year":"2019","papers":1},{"year":"2020","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/multiple-random-window-discriminator"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}