{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-neural-acoustic-fields-1","title":"Learning Neural Acoustic Fields","arxiv_id":"2204.00628","date":"2022-04-04","proceeding":null,"authors":["Andrew Luo","Yilun Du","Michael J. Tarr","Joshua B. Tenenbaum","Antonio Torralba","Chuang Gan"],"abstract":"Our environment is filled with rich and dynamic acoustic information. When we walk into a cathedral, the reverberations as much as appearance inform us of the sanctuary's wide open space. Similarly, as an object moves around us, we expect the sound emitted to also exhibit this movement. While recent advances in learned implicit functions have led to increasingly higher quality representations of the visual world, there have not been commensurate advances in learning spatial auditory representations. To address this gap, we introduce Neural Acoustic Fields (NAFs), an implicit representation that captures how sounds propagate in a physical scene. By modeling acoustic propagation in a scene as a linear time-invariant system, NAFs learn to continuously map all emitter and listener location pairs to a neural impulse response function that can then be applied to arbitrary sounds. We demonstrate that the continuous nature of NAFs enables us to render spatial acoustics for a listener at an arbitrary location, and can predict sound propagation at novel locations. We further show that the representation learned by NAFs can help improve visual learning with sparse views. Finally, we show that a representation informative of scene structure emerges during the learning of NAFs.","url_abs":"https://arxiv.org/abs/2204.00628v2","url_pdf":"https://arxiv.org/pdf/2204.00628v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-neural-acoustic-fields-1","repo_url":"https://github.com/aluo-x/learning_neural_acoustic_fields","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.00628","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.00628"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aluo-x/learning_neural_acoustic_fields","reach":null}],"summary":{"ran":2,"ran_honours":1,"ran_fixture":1,"unverified":1},"by_repo_kind":{"listed":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8f03661acfbc79fd","entry":"basic_project2","repo":"aluo-x/learning_neural_acoustic_fields","repo_kind":"listed","path":"model/networks.py","file_url":"https://github.com/aluo-x/learning_neural_acoustic_fields/blob/HEAD/model/networks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8f03661acfbc79fd"}},{"code_sha256_prefix":"3fa206e7936537d5","entry":"distance","repo":"aluo-x/learning_neural_acoustic_fields","repo_kind":"listed","path":"model/networks.py","file_url":"https://github.com/aluo-x/learning_neural_acoustic_fields/blob/HEAD/model/networks.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3fa206e7936537d5"}},{"code_sha256_prefix":"6033fd3d0354c053","entry":"fit_predict_torch","repo":"aluo-x/learning_neural_acoustic_fields","repo_kind":"listed","path":"model/networks.py","file_url":"https://github.com/aluo-x/learning_neural_acoustic_fields/blob/HEAD/model/networks.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6033fd3d0354c053"}},{"code_sha256_prefix":"e87a2b5a6d409a44","entry":"kernel_linear_act","repo":"aluo-x/learning_neural_acoustic_fields","repo_kind":"listed","path":"model/networks.py","file_url":"https://github.com/aluo-x/learning_neural_acoustic_fields/blob/HEAD/model/networks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e87a2b5a6d409a44"}},{"code_sha256_prefix":"4013baff98fbee11","entry":"kernel_residual_fc_embeds","repo":"aluo-x/learning_neural_acoustic_fields","repo_kind":"listed","path":"model/networks.py","file_url":"https://github.com/aluo-x/learning_neural_acoustic_fields/blob/HEAD/model/networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4013baff98fbee11"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}