{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-multi-scale-optimization-learning-framework","title":"Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond","arxiv_id":"2004.14557","date":"2020-04-30","proceeding":null,"authors":["Risheng Liu","Zi Li","Xin Fan","Chenying Zhao","Hao Huang","Zhongxuan Luo"],"abstract":"Conventional deformable registration methods aim at solving an optimization model carefully designed on image pairs and their computational costs are exceptionally high. In contrast, recent deep learning based approaches can provide fast deformation estimation. These heuristic network architectures are fully data-driven and thus lack explicit geometric constraints, e.g., topology-preserving, which are indispensable to generate plausible deformations. We design a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation in order to integrate advantages and avoid limitations of these two categories of approaches. Specifically, we introduce a generic optimization model to formulate diffeomorphic registration and develop a series of learnable architectures to obtain propagative updating in the coarse-to-fine feature space. Moreover, we propose a novel bilevel self-tuned training strategy, allowing efficient search of task-specific hyper-parameters. This training strategy increases the flexibility to various types of data while reduces computational and human burdens. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data. Extensive results demonstrate the state-of-the-art performance of the proposed method with diffeomorphic guarantee and extreme efficiency. We also apply our framework to challenging multi-modal image registration, and investigate how our registration to support the down-streaming tasks for medical image analysis including multi-modal fusion and image segmentation.","url_abs":"https://arxiv.org/abs/2004.14557v4","url_pdf":"https://arxiv.org/pdf/2004.14557v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-multi-scale-optimization-learning-framework","repo_url":"https://github.com/Alison-brie/MultiPropReg","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"a-multi-scale-optimization-learning-framework","repo_url":"https://github.com/dut-media-lab/MultiPropReg","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-registration","task_name":"Image Registration"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"medical-image-analysis","task_name":"Medical Image Analysis"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"3d-convolution","method_name":"3D Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.14557","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.14557"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dut-media-lab/MultiPropReg","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Alison-brie/MultiPropReg","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":13},"by_repo_kind":{"official":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1fd1a81503e31013","entry":"MINDSSC","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MIND.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MIND.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1fd1a81503e31013"}},{"code_sha256_prefix":"3991b1d1d129c001","entry":"MatchCost","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MultiModal/layers.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MultiModal/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3991b1d1d129c001"}},{"code_sha256_prefix":"c516c53184ea0a6b","entry":"boundingbox","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"ext/pynd/ndutils.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/ext/pynd/ndutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c516c53184ea0a6b"}},{"code_sha256_prefix":"52abec54f9082f54","entry":"bw2sdtrf","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"ext/pynd/ndutils.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/ext/pynd/ndutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52abec54f9082f54"}},{"code_sha256_prefix":"7d3d4ac668b84a80","entry":"bwdist","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"ext/pynd/ndutils.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/ext/pynd/ndutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d3d4ac668b84a80"}},{"code_sha256_prefix":"0587a796d489669a","entry":"compute_local_sums","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"losses.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0587a796d489669a"}},{"code_sha256_prefix":"44191cc43b143bfd","entry":"conv","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MultiModal/layers.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MultiModal/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"44191cc43b143bfd"}},{"code_sha256_prefix":"3e816289579cc9e9","entry":"count_parameters_in_MB","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"utils.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e816289579cc9e9"}},{"code_sha256_prefix":"67c81b2eb8a2cf43","entry":"dice","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"utils.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"67c81b2eb8a2cf43"}},{"code_sha256_prefix":"bc93fe252379534f","entry":"mind_loss","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MIND.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MIND.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc93fe252379534f"}},{"code_sha256_prefix":"7d0ffd3245e38bd5","entry":"ncc","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"losses.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d0ffd3245e38bd5"}},{"code_sha256_prefix":"ebd04f809925dd6e","entry":"pdist_squared","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MIND.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MIND.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ebd04f809925dd6e"}},{"code_sha256_prefix":"06221ade5bbdb0bf","entry":"predict_flow","repo":"Alison-brie/MultiPropReg","repo_kind":"official","path":"MultiModal/layers.py","file_url":"https://github.com/Alison-brie/MultiPropReg/blob/HEAD/MultiModal/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06221ade5bbdb0bf"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}