{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/flashaudio-rectified-flows-for-fast-and-high","title":"FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation","arxiv_id":"2410.12266","date":"2024-10-16","proceeding":null,"authors":["Huadai Liu","Jialei Wang","Rongjie Huang","Yang Liu","Heng Lu","Zhou Zhao","Wei Xue"],"abstract":"Recent advancements in latent diffusion models (LDMs) have markedly enhanced text-to-audio generation, yet their iterative sampling processes impose substantial computational demands, limiting practical deployment. While recent methods utilizing consistency-based distillation aim to achieve few-step or single-step inference, their one-step performance is constrained by curved trajectories, preventing them from surpassing traditional diffusion models. In this work, we introduce FlashAudio with rectified flows to learn straight flow for fast simulation. To alleviate the inefficient timesteps allocation and suboptimal distribution of noise, FlashAudio optimizes the time distribution of rectified flow with Bifocal Samplers and proposes immiscible flow to minimize the total distance of data-noise pairs in a batch vias assignment. Furthermore, to address the amplified accumulation error caused by the classifier-free guidance (CFG), we propose Anchored Optimization, which refines the guidance scale by anchoring it to a reference trajectory. Experimental results on text-to-audio generation demonstrate that FlashAudio's one-step generation performance surpasses the diffusion-based models with hundreds of sampling steps on audio quality and enables a sampling speed of 400x faster than real-time on a single NVIDIA 4090Ti GPU. Code will be available at https://github.com/liuhuadai/FlashAudio.","url_abs":"https://arxiv.org/abs/2410.12266v2","url_pdf":"https://arxiv.org/pdf/2410.12266v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"flashaudio-rectified-flows-for-fast-and-high","repo_url":"https://github.com/Text-to-Audio/AudioLCM","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"audio-generation","task_name":"Audio Generation"},{"task_slug":null,"task_name":"GPU"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.12266","atlas_url":"https://app.syntology.ai/?focus=2410.12266","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.12266"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Text-to-Audio/AudioLCM","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":4,"ran":2,"ran_violates":2,"unverified":2},"by_repo_kind":{"listed":{"samples":10,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"9fcdaa6e423e8aa7","entry":"Normalize","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/models/autoencoder1d.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/models/autoencoder1d.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9fcdaa6e423e8aa7"}},{"code_sha256_prefix":"fe5dd5258046898c","entry":"always","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/modules/x_transformer.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/modules/x_transformer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fe5dd5258046898c"}},{"code_sha256_prefix":"f11b59ba32ad8d75","entry":"cal_score_by_csv","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"wav_evaluation/cal_clap_score.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/wav_evaluation/cal_clap_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f11b59ba32ad8d75"}},{"code_sha256_prefix":"424012cb37b31172","entry":"default","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/modules/attention.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"424012cb37b31172"}},{"code_sha256_prefix":"aa5486a3650902d8","entry":"exists","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/modules/attention.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aa5486a3650902d8"}},{"code_sha256_prefix":"d72762b700feee6f","entry":"ismap","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/util.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d72762b700feee6f"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/models/autoencoder1d.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/models/autoencoder1d.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"9a299fe5ae09e407","entry":"uniq","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/modules/attention.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/modules/attention.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9a299fe5ae09e407"}},{"code_sha256_prefix":"f9bd2e83191afad1","entry":"log_txt_as_img","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/util.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9bd2e83191afad1"}},{"code_sha256_prefix":"c8d9d38b144e401f","entry":"md5_hash","repo":"Text-to-Audio/AudioLCM","repo_kind":"listed","path":"ldm/util.py","file_url":"https://github.com/Text-to-Audio/AudioLCM/blob/HEAD/ldm/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c8d9d38b144e401f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}