{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/frequency-decoupling-for-motion-magnification","title":"Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecture","arxiv_id":"2403.07347","date":"2024-03-12","proceeding":"CVPR 2024 1","authors":["Fei Wang","Dan Guo","Kun Li","Zhun Zhong","Meng Wang"],"abstract":"Video Motion Magnification (VMM) aims to reveal subtle and imperceptible motion information of objects in the macroscopic world. Prior methods directly model the motion field from the Eulerian perspective by Representation Learning that separates shape and texture or Multi-domain Learning from phase fluctuations. Inspired by the frequency spectrum, we observe that the low-frequency components with stable energy always possess spatial structure and less noise, making them suitable for modeling the subtle motion field. To this end, we present FD4MM, a new paradigm of Frequency Decoupling for Motion Magnification with a Multi-level Isomorphic Architecture to capture multi-level high-frequency details and a stable low-frequency structure (motion field) in video space. Since high-frequency details and subtle motions are susceptible to information degradation due to their inherent subtlety and unavoidable external interference from noise, we carefully design Sparse High/Low-pass Filters to enhance the integrity of details and motion structures, and a Sparse Frequency Mixer to promote seamless recoupling. Besides, we innovatively design a contrastive regularization for this task to strengthen the model's ability to discriminate irrelevant features, reducing undesired motion magnification. Extensive experiments on both Real-world and Synthetic Datasets show that our FD4MM outperforms SOTA methods. Meanwhile, FD4MM reduces FLOPs by 1.63$\\times$ and boosts inference speed by 1.68$\\times$ than the latest method. Our code is available at https://github.com/Jiafei127/FD4MM.","url_abs":"https://arxiv.org/abs/2403.07347v2","url_pdf":"https://arxiv.org/pdf/2403.07347v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"frequency-decoupling-for-motion-magnification","repo_url":"https://github.com/jiafei127/fd4mm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"frequency-decoupling-for-motion-magnification","repo_url":"https://github.com/ZhengPeng7/motion_magnification_learning-based","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"motion-magnification","task_name":"Motion Magnification"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.07347","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.07347"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Jiafei127/FD4MM","reach":null}],"summary":{"ran":8,"unverified":6},"by_repo_kind":{"official":{"samples":14,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3872816527083689","entry":"FreqDec","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3872816527083689"}},{"code_sha256_prefix":"24fd50b60dd3dad4","entry":"FreqMixer","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24fd50b60dd3dad4"}},{"code_sha256_prefix":"7ba83054b670e294","entry":"HighpassMixer","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7ba83054b670e294"}},{"code_sha256_prefix":"97cc636e2d3de32c","entry":"Mlp","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"97cc636e2d3de32c"}},{"code_sha256_prefix":"4c8394b0b6dd4d83","entry":"OverlapPatchEmbed","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c8394b0b6dd4d83"}},{"code_sha256_prefix":"0b72fc553533515e","entry":"Sparse_Highpass_Filter","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b72fc553533515e"}},{"code_sha256_prefix":"5d4d8dd08a427ba4","entry":"Sparse_Lowpass_Filter","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d4d8dd08a427ba4"}},{"code_sha256_prefix":"326a20276e854360","entry":"Upsample","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"326a20276e854360"}},{"code_sha256_prefix":"009cebf0b808d5b7","entry":"AFreqMixer","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"009cebf0b808d5b7"}},{"code_sha256_prefix":"94eca4cce92e1345","entry":"Freq_Pyramid","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94eca4cce92e1345"}},{"code_sha256_prefix":"1428acfae0d9c3bd","entry":"LowpassMixer","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1428acfae0d9c3bd"}},{"code_sha256_prefix":"b8c2127e218da170","entry":"MagNet","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8c2127e218da170"}},{"code_sha256_prefix":"ca2b178bfdb9c0fb","entry":"Manipulator","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ca2b178bfdb9c0fb"}},{"code_sha256_prefix":"e850aff262afad31","entry":"Pyramid_recons","repo":"Jiafei127/FD4MM","repo_kind":"official","path":"magnet_FD4MM.py","file_url":"https://github.com/Jiafei127/FD4MM/blob/HEAD/magnet_FD4MM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e850aff262afad31"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}