{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/e-bats-efficient-backpropagation-free-test","title":"E-BATS: Efficient Backpropagation-Free Test-Time Adaptation for Speech Foundation Models","arxiv_id":"2506.07078","date":"2025-06-08","proceeding":null,"authors":["Jiaheng Dong","Hong Jia","Soumyajit Chatterjee","Abhirup Ghosh","James Bailey","Ting Dang"],"abstract":"Speech Foundation Models encounter significant performance degradation when deployed in real-world scenarios involving acoustic domain shifts, such as background noise and speaker accents. Test-time adaptation (TTA) has recently emerged as a viable strategy to address such domain shifts at inference time without requiring access to source data or labels. However, existing TTA approaches, particularly those relying on backpropagation, are memory-intensive, limiting their applicability in speech tasks and resource-constrained settings. Although backpropagation-free methods offer improved efficiency, existing ones exhibit poor accuracy. This is because they are predominantly developed for vision tasks, which fundamentally differ from speech task formulations, noise characteristics, and model architecture, posing unique transferability challenges. In this paper, we introduce E-BATS, the first Efficient BAckpropagation-free TTA framework designed explicitly for speech foundation models. E-BATS achieves a balance between adaptation effectiveness and memory efficiency through three key components: (i) lightweight prompt adaptation for a forward-pass-based feature alignment, (ii) a multi-scale loss to capture both global (utterance-level) and local distribution shifts (token-level) and (iii) a test-time exponential moving average mechanism for stable adaptation across utterances. Experiments conducted on four noisy speech datasets spanning sixteen acoustic conditions demonstrate consistent improvements, with 4.1%-13.5% accuracy gains over backpropagation-free baselines and 2.0-6.4 times GPU memory savings compared to backpropagation-based methods. By enabling scalable and robust adaptation under acoustic variability, this work paves the way for developing more efficient adaptation approaches for practical speech processing systems in real-world environments.","url_abs":"https://arxiv.org/abs/2506.07078v1","url_pdf":"https://arxiv.org/pdf/2506.07078v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":null,"task_name":"GPU"},{"task_slug":"test-time-adaptation","task_name":"Test-time Adaptation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2506.07078","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2506.07078"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/JiahengDong/E-BATS","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":2,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"637d5c091517bb60","entry":"confidence_scaling","repo":"JiahengDong/E-BATS","repo_kind":"found_in_text","path":"TTAs-2/E-BATS.py","file_url":"https://github.com/JiahengDong/E-BATS/blob/HEAD/TTAs-2/E-BATS.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"637d5c091517bb60"}},{"code_sha256_prefix":"e861faa5269ebbd7","entry":"forward_and_get_loss","repo":"JiahengDong/E-BATS","repo_kind":"found_in_text","path":"TTAs-2/E-BATS.py","file_url":"https://github.com/JiahengDong/E-BATS/blob/HEAD/TTAs-2/E-BATS.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e861faa5269ebbd7"}},{"code_sha256_prefix":"c549267af6d34f9a","entry":"softmax_entropy","repo":"JiahengDong/E-BATS","repo_kind":"found_in_text","path":"TTAs-2/E-BATS.py","file_url":"https://github.com/JiahengDong/E-BATS/blob/HEAD/TTAs-2/E-BATS.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c549267af6d34f9a"}},{"code_sha256_prefix":"d986ac977d6f97d7","entry":"forward_and_adapt","repo":"JiahengDong/E-BATS","repo_kind":"found_in_text","path":"TTAs-2/E-BATS.py","file_url":"https://github.com/JiahengDong/E-BATS/blob/HEAD/TTAs-2/E-BATS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d986ac977d6f97d7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}