{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-domain-knowledge-inspired-music-embedding","title":"A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling","arxiv_id":"2212.00973","date":"2022-12-02","proceeding":null,"authors":["Z. Guo","J. Kang","D. Herremans"],"abstract":"Following the success of the transformer architecture in the natural language domain, transformer-like architectures have been widely applied to the domain of symbolic music recently. Symbolic music and text, however, are two different modalities. Symbolic music contains multiple attributes, both absolute attributes (e.g., pitch) and relative attributes (e.g., pitch interval). These relative attributes shape human perception of musical motifs. These important relative attributes, however, are mostly ignored in existing symbolic music modeling methods with the main reason being the lack of a musically-meaningful embedding space where both the absolute and relative embeddings of the symbolic music tokens can be efficiently represented. In this paper, we propose the Fundamental Music Embedding (FME) for symbolic music based on a bias-adjusted sinusoidal encoding within which both the absolute and the relative attributes can be embedded and the fundamental musical properties (e.g., translational invariance) are explicitly preserved. Taking advantage of the proposed FME, we further propose a novel attention mechanism based on the relative index, pitch and onset embeddings (RIPO attention) such that the musical domain knowledge can be fully utilized for symbolic music modeling. Experiment results show that our proposed model: RIPO transformer which utilizes FME and RIPO attention outperforms the state-of-the-art transformers (i.e., music transformer, linear transformer) in a melody completion task. Moreover, using the RIPO transformer in a downstream music generation task, we notice that the notorious degeneration phenomenon no longer exists and the music generated by the RIPO transformer outperforms the music generated by state-of-the-art transformer models in both subjective and objective evaluations.","url_abs":"https://arxiv.org/abs/2212.00973v1","url_pdf":"https://arxiv.org/pdf/2212.00973v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-domain-knowledge-inspired-music-embedding","repo_url":"https://github.com/guozixunnicolas/fundamentalmusicembedding","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"music-generation","task_name":"Music Generation"},{"task_slug":"music-modeling","task_name":"Music Modeling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2212.00973","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.00973"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/guozixunnicolas/fundamentalmusicembedding","reach":{"status":"ok"}}],"summary":{"ran_honours":2,"ran_draft_wrong":2},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"0fc5d9cde41807d8","entry":"l2_norm","repo":"guozixunnicolas/fundamentalmusicembedding","repo_kind":"official","path":"model/FME_music_positional_encoding.py","file_url":"https://github.com/guozixunnicolas/fundamentalmusicembedding/blob/HEAD/model/FME_music_positional_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0fc5d9cde41807d8"}},{"code_sha256_prefix":"e561180dff3faff6","entry":"rounding","repo":"guozixunnicolas/fundamentalmusicembedding","repo_kind":"official","path":"model/FME_music_positional_encoding.py","file_url":"https://github.com/guozixunnicolas/fundamentalmusicembedding/blob/HEAD/model/FME_music_positional_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e561180dff3faff6"}},{"code_sha256_prefix":"eabaf7cdb398a215","entry":"scaled_dot_product","repo":"guozixunnicolas/fundamentalmusicembedding","repo_kind":"official","path":"model/layers.py","file_url":"https://github.com/guozixunnicolas/fundamentalmusicembedding/blob/HEAD/model/layers.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"eabaf7cdb398a215"}},{"code_sha256_prefix":"88bf809d1bc9db4c","entry":"sequence_mask","repo":"guozixunnicolas/fundamentalmusicembedding","repo_kind":"official","path":"model/layers.py","file_url":"https://github.com/guozixunnicolas/fundamentalmusicembedding/blob/HEAD/model/layers.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"88bf809d1bc9db4c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}