{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-14791","title":"From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation","arxiv_id":"2606.14791","date":"2026-06-11","proceeding":null,"authors":["Fengrui Liu","Ruiyang Huang","Qijian Zheng","Yuanfang Wang","Feng Liu"],"abstract":"Self-supervised learning advances audio representation for multimedia analysis. However, prevailing data-centric approaches rely on massive real-world corpora, increasing training costs, curation burdens, and privacy barriers. To address this, we present AudioPG, a procedural synthesis framework eliminating real audio recordings during pre-training. AudioPG trains a Transformer-based masked autoencoder on waveforms generated on-the-fly from basic acoustic primitives and composition rules. The encoder transfers effectively to real audio benchmarks, achieving 90.60% accuracy on ESC-50, 0.546 mAP on FSD50K, 88.17% on UrbanSound8K, and 97.03% on Speech Commands V2. Notably, pre-training completes in under 20 minutes on a single GPU. Latent space analysis reveals physical factors, including fundamental frequency and relative intensity, emerge in orthogonal subspaces, making representations linearly decodable. These results establish procedural synthesis as an efficient, interpretable pre-training signal when large-scale corpora are unavailable. Our code is available at: https://github.com/Freyliu0516/audioPG.","url_abs":"https://arxiv.org/abs/2606.14791","url_pdf":"https://arxiv.org/pdf/2606.14791","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.14791","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.14791"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Freyliu0516/audioPG","reach":null}],"summary":{"ran":12,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":17,"ran":12,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"d0771ecccbe4080b","entry":"add_background_noise","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/modifiers.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/modifiers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d0771ecccbe4080b"}},{"code_sha256_prefix":"07396c702b10bdd3","entry":"apply_random_temporal_modulation","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/dynamics.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/dynamics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"07396c702b10bdd3"}},{"code_sha256_prefix":"779c218575270c71","entry":"broadband_pulse_wave","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/primitives.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/primitives.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"779c218575270c71"}},{"code_sha256_prefix":"18a00e456bbec1f0","entry":"compute_disentanglement_score","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"analyze_disentangle.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/analyze_disentangle.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"18a00e456bbec1f0"}},{"code_sha256_prefix":"5b30efd8baaad617","entry":"compute_mutual_information","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"visualize_filters.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/visualize_filters.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b30efd8baaad617"}},{"code_sha256_prefix":"d6be70472b572fed","entry":"fm_synthesis","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/primitives.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/primitives.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d6be70472b572fed"}},{"code_sha256_prefix":"d523f56182d4a4ec","entry":"get_2d_sincos_pos_embed","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"models/audiomae.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/models/audiomae.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d523f56182d4a4ec"}},{"code_sha256_prefix":"96bfaa2107621c85","entry":"get_2d_sincos_pos_embed_flexible","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"models/audiomae.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/models/audiomae.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"96bfaa2107621c85"}},{"code_sha256_prefix":"868c4570fda68f32","entry":"harmonic_additive_synthesis","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/primitives.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/primitives.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"868c4570fda68f32"}},{"code_sha256_prefix":"38dad7b70fff21f1","entry":"inject_transient_noise","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/dynamics.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/dynamics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"38dad7b70fff21f1"}},{"code_sha256_prefix":"a27c6867228ee71c","entry":"peak_normalize","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/modifiers.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/modifiers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a27c6867228ee71c"}},{"code_sha256_prefix":"0e1e7e6647ead041","entry":"place_multiple_events","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"synthesizer/dynamics.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/synthesizer/dynamics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0e1e7e6647ead041"}},{"code_sha256_prefix":"834e5392d5e3abd6","entry":"analyze_neuron_disentanglement","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"analyze_disentangle.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/analyze_disentangle.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"834e5392d5e3abd6"}},{"code_sha256_prefix":"572240b722c323a0","entry":"get_2d_sincos_pos_embed_from_grid","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"models/audiomae.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/models/audiomae.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"572240b722c323a0"}},{"code_sha256_prefix":"7fc96979939324ca","entry":"kraskov_mi_estimator","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"analyze_disentangle.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/analyze_disentangle.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7fc96979939324ca"}},{"code_sha256_prefix":"9bb4a1675545b47a","entry":"pca_visualization","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"visualize_filters.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/visualize_filters.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9bb4a1675545b47a"}},{"code_sha256_prefix":"1f520405cced158e","entry":"tsne_visualization","repo":"Freyliu0516/audioPG","repo_kind":"found_in_text","path":"visualize_filters.py","file_url":"https://github.com/Freyliu0516/audioPG/blob/HEAD/visualize_filters.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1f520405cced158e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}