{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-high-frequency-functions-made-easy","title":"Learning High-Frequency Functions Made Easy with Sinusoidal Positional Encoding","arxiv_id":"2407.09370","date":"2024-07-12","proceeding":null,"authors":["Chuanhao Sun","Zhihang Yuan","Kai Xu","Luo Mai","N. Siddharth","Shuo Chen","Mahesh K. Marina"],"abstract":"Fourier features based positional encoding (PE) is commonly used in machine learning tasks that involve learning high-frequency features from low-dimensional inputs, such as 3D view synthesis and time series regression with neural tangent kernels. Despite their effectiveness, existing PEs require manual, empirical adjustment of crucial hyperparameters, specifically the Fourier features, tailored to each unique task. Further, PEs face challenges in efficiently learning high-frequency functions, particularly in tasks with limited data. In this paper, we introduce sinusoidal PE (SPE), designed to efficiently learn adaptive frequency features closely aligned with the true underlying function. Our experiments demonstrate that SPE, without hyperparameter tuning, consistently achieves enhanced fidelity and faster training across various tasks, including 3D view synthesis, Text-to-Speech generation, and 1D regression. SPE is implemented as a direct replacement for existing PEs. Its plug-and-play nature lets numerous tasks easily adopt and benefit from SPE.","url_abs":"https://arxiv.org/abs/2407.09370v2","url_pdf":"https://arxiv.org/pdf/2407.09370v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-high-frequency-functions-made-easy","repo_url":"https://github.com/zhyuan11/SPE","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"text-to-speech","task_name":"Text to Speech"},{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series-regression","task_name":"Time Series Regression"},{"task_slug":"regression-1","task_name":"regression"},{"task_slug":"text-to-speech-1","task_name":"text-to-speech"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2407.09370","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.09370"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhyuan11/SPE","reach":null}],"summary":{"ran":1,"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"657d6eb05f4579f2","entry":"FakeEmbedder","repo":"zhyuan11/SPE","repo_kind":"official","path":"codes/3d_NeRF/run_nerf_helpers.py","file_url":"https://github.com/zhyuan11/SPE/blob/HEAD/codes/3d_NeRF/run_nerf_helpers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"657d6eb05f4579f2"}},{"code_sha256_prefix":"fd57e365830d09de","entry":"batchify","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"fd57e365830d09de"}},{"code_sha256_prefix":"d3f2a9504d27085e","entry":"batchifyadd","repo":"zhyuan11/spe","repo_kind":"official","path":"codes/3d_NeRF/run_nerf.py","file_url":"https://github.com/zhyuan11/spe/blob/HEAD/codes/3d_NeRF/run_nerf.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3f2a9504d27085e"}},{"code_sha256_prefix":"a0a5281ac4dfe52d","entry":"get_embedder","repo":"zhyuan11/SPE","repo_kind":"official","path":"codes/3d_NeRF/run_nerf_helpers.py","file_url":"https://github.com/zhyuan11/SPE/blob/HEAD/codes/3d_NeRF/run_nerf_helpers.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0a5281ac4dfe52d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}