{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/image2reverb-cross-modal-reverb-impulse","title":"Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis","arxiv_id":"2103.14201","date":"2021-03-26","proceeding":"ICCV 2021 10","authors":["Nikhil Singh","Jeff Mentch","Jerry Ng","Matthew Beveridge","Iddo Drori"],"abstract":"Measuring the acoustic characteristics of a space is often done by capturing its impulse response (IR), a representation of how a full-range stimulus sound excites it. This work generates an IR from a single image, which can then be applied to other signals using convolution, simulating the reverberant characteristics of the space shown in the image. Recording these IRs is both time-intensive and expensive, and often infeasible for inaccessible locations. We use an end-to-end neural network architecture to generate plausible audio impulse responses from single images of acoustic environments. We evaluate our method both by comparisons to ground truth data and by human expert evaluation. We demonstrate our approach by generating plausible impulse responses from diverse settings and formats including well known places, musical halls, rooms in paintings, images from animations and computer games, synthetic environments generated from text, panoramic images, and video conference backgrounds.","url_abs":"https://arxiv.org/abs/2103.14201v2","url_pdf":"https://arxiv.org/pdf/2103.14201v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"image2reverb-cross-modal-reverb-impulse","repo_url":"https://github.com/nikhilsinghmus/image2reverb","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.14201","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.14201"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/nikhilsinghmus/image2reverb","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"unverified":5},"by_repo_kind":{"official":{"samples":6,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a739072b350093e7","entry":"upsample","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/layers.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/layers.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a739072b350093e7"}},{"code_sha256_prefix":"12126a9690e1dfa5","entry":"compare_t60","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/util.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12126a9690e1dfa5"}},{"code_sha256_prefix":"247acfd284a33881","entry":"estimate_t60","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/util.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"247acfd284a33881"}},{"code_sha256_prefix":"20819e49f8965dd6","entry":"hilbert","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/util.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"20819e49f8965dd6"}},{"code_sha256_prefix":"a67f649562ac1b42","entry":"is_image_audio_file","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/dataset.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a67f649562ac1b42"}},{"code_sha256_prefix":"14045af0f4c34864","entry":"make_dataset","repo":"nikhilsinghmus/image2reverb","repo_kind":"official","path":"image2reverb/dataset.py","file_url":"https://github.com/nikhilsinghmus/image2reverb/blob/HEAD/image2reverb/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"14045af0f4c34864"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}