{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/echoworld-learning-motion-aware-world-models","title":"EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance","arxiv_id":"2504.13065","date":"2025-04-17","proceeding":"CVPR 2025 1","authors":["Yang Yue","Yulin Wang","Haojun Jiang","Pan Liu","Shiji Song","Gao Huang"],"abstract":"Echocardiography is crucial for cardiovascular disease detection but relies heavily on experienced sonographers. Echocardiography probe guidance systems, which provide real-time movement instructions for acquiring standard plane images, offer a promising solution for AI-assisted or fully autonomous scanning. However, developing effective machine learning models for this task remains challenging, as they must grasp heart anatomy and the intricate interplay between probe motion and visual signals. To address this, we present EchoWorld, a motion-aware world modeling framework for probe guidance that encodes anatomical knowledge and motion-induced visual dynamics, while effectively leveraging past visual-motion sequences to enhance guidance precision. EchoWorld employs a pre-training strategy inspired by world modeling principles, where the model predicts masked anatomical regions and simulates the visual outcomes of probe adjustments. Built upon this pre-trained model, we introduce a motion-aware attention mechanism in the fine-tuning stage that effectively integrates historical visual-motion data, enabling precise and adaptive probe guidance. Trained on more than one million ultrasound images from over 200 routine scans, EchoWorld effectively captures key echocardiographic knowledge, as validated by qualitative analysis. Moreover, our method significantly reduces guidance errors compared to existing visual backbones and guidance frameworks, excelling in both single-frame and sequential evaluation protocols. Code is available at https://github.com/LeapLabTHU/EchoWorld.","url_abs":"https://arxiv.org/abs/2504.13065v1","url_pdf":"https://arxiv.org/pdf/2504.13065v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"echoworld-learning-motion-aware-world-models","repo_url":"https://github.com/LeapLabTHU/EchoWorld","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"anatomy","task_name":"Anatomy"}],"methods":[{"method_slug":"attention","method_name":"Attention"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2504.13065","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2504.13065"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/LeapLabTHU/EchoWorld","reach":null}],"summary":{"ran":3,"ran_fixture":4,"unverified":3},"by_repo_kind":{"official":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"5934d853f37ea762","entry":"Attention","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5934d853f37ea762"}},{"code_sha256_prefix":"c5eb872d53271c4a","entry":"MLPBlock","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c5eb872d53271c4a"}},{"code_sha256_prefix":"997482d489b078e0","entry":"PatchEmbed","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"997482d489b078e0"}},{"code_sha256_prefix":"3a2905385d39a388","entry":"add_decomposed_rel_pos","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3a2905385d39a388"}},{"code_sha256_prefix":"d51d94a92bbaf66b","entry":"get_rel_pos","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d51d94a92bbaf66b"}},{"code_sha256_prefix":"105fa08885dc36cc","entry":"window_partition","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"105fa08885dc36cc"}},{"code_sha256_prefix":"50f37d517e2be27f","entry":"window_unpartition","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"50f37d517e2be27f"}},{"code_sha256_prefix":"beaafdedb34a8817","entry":"Block","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"beaafdedb34a8817"}},{"code_sha256_prefix":"718946c94410a384","entry":"ImageEncoderViT","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"718946c94410a384"}},{"code_sha256_prefix":"9c6f7f41923c66d3","entry":"build_lvm_med","repo":"LeapLabTHU/EchoWorld","repo_kind":"official","path":"finetune/models/lvm_med.py","file_url":"https://github.com/LeapLabTHU/EchoWorld/blob/HEAD/finetune/models/lvm_med.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9c6f7f41923c66d3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}