{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/univnet-a-neural-vocoder-with-multi","title":"UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation","arxiv_id":"2106.07889","date":"2021-06-15","proceeding":null,"authors":["Won Jang","Dan Lim","Jaesam Yoon","BongWan Kim","Juntae Kim"],"abstract":"Most neural vocoders employ band-limited mel-spectrograms to generate waveforms. If full-band spectral features are used as the input, the vocoder can be provided with as much acoustic information as possible. However, in some models employing full-band mel-spectrograms, an over-smoothing problem occurs as part of which non-sharp spectrograms are generated. To address this problem, we propose UnivNet, a neural vocoder that synthesizes high-fidelity waveforms in real time. Inspired by works in the field of voice activity detection, we added a multi-resolution spectrogram discriminator that employs multiple linear spectrogram magnitudes computed using various parameter sets. Using full-band mel-spectrograms as input, we expect to generate high-resolution signals by adding a discriminator that employs spectrograms of multiple resolutions as the input. In an evaluation on a dataset containing information on hundreds of speakers, UnivNet obtained the best objective and subjective results among competing models for both seen and unseen speakers. These results, including the best subjective score for text-to-speech, demonstrate the potential for fast adaptation to new speakers without a need for training from scratch.","url_abs":"https://arxiv.org/abs/2106.07889v1","url_pdf":"https://arxiv.org/pdf/2106.07889v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/coqui-ai/TTS","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MPL-2.0"}},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/komyeongjin/specdiff-gan","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/maum-ai/univnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/mindslab-ai/univnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/neonbjb/tortoise-tts","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/rishikksh20/UnivNet-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/MS-P3/code7/tree/main/univnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/MindCode-4/code-1/tree/main/univnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"univnet-a-neural-vocoder-with-multi","repo_url":"https://github.com/MindCode-4/code-5/tree/main/univnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"speech-synthesis","task_name":"Speech Synthesis"},{"task_slug":"text-to-speech","task_name":"Text to Speech"},{"task_slug":"text-to-speech-1","task_name":"text-to-speech"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2106.07889","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.07889"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/neonbjb/tortoise-tts","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-5/tree/main/univnet","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-1/tree/main/univnet","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mindslab-ai/univnet","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/coqui-ai/TTS","reach":{"status":"ok","spdx":"MPL-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rishikksh20/UnivNet-pytorch","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MS-P3/code7/tree/main/univnet","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/komyeongjin/specdiff-gan","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/maum-ai/univnet","reach":null}],"summary":{"ran":4,"ran_honours":1,"ran_draft_wrong":2,"ran_fixture":1,"unverified":4},"by_repo_kind":{"listed":{"samples":11,"ran":7,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"7137577cbef51217","entry":"discriminator_loss","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"loss.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/loss.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7137577cbef51217"}},{"code_sha256_prefix":"e453b51f0ed5fb28","entry":"feature_loss","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"loss.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/loss.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e453b51f0ed5fb28"}},{"code_sha256_prefix":"1a9d74439d969cfd","entry":"generator_loss","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"loss.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/loss.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1a9d74439d969cfd"}},{"code_sha256_prefix":"a26f85d7c72ef39a","entry":"get_padding","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a26f85d7c72ef39a"}},{"code_sha256_prefix":"19c9fe23dc000c61","entry":"load_checkpoint","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19c9fe23dc000c61"}},{"code_sha256_prefix":"8043eaefe4c09c1f","entry":"load_wav","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"meldataset.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/meldataset.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8043eaefe4c09c1f"}},{"code_sha256_prefix":"ef08b07bfdc86c88","entry":"pad_or_truncate","repo":"neonbjb/tortoise-tts","repo_kind":"listed","path":"tortoise/api.py","file_url":"https://github.com/neonbjb/tortoise-tts/blob/HEAD/tortoise/api.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ef08b07bfdc86c88"}},{"code_sha256_prefix":"2b5c06c1ba593c3c","entry":"read_lexicon","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"2b5c06c1ba593c3c"}},{"code_sha256_prefix":"be031b15a988a556","entry":"dynamic_range_compression","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"meldataset.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/meldataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be031b15a988a556"}},{"code_sha256_prefix":"9e30e7d510c9d341","entry":"dynamic_range_decompression","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"meldataset.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/meldataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e30e7d510c9d341"}},{"code_sha256_prefix":"8520e6e61b8bf789","entry":"plot_spectrogram","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8520e6e61b8bf789"}},{"code_sha256_prefix":"d40b7ea72ed329ed","entry":"stft","repo":"rishikksh20/UnivNet-pytorch","repo_kind":"listed","path":"stft_loss.py","file_url":"https://github.com/rishikksh20/UnivNet-pytorch/blob/HEAD/stft_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d40b7ea72ed329ed"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}