{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ladder-fine-tuning-approach-for-sam","title":"Ladder Fine-tuning approach for SAM integrating complementary network","arxiv_id":"2306.12737","date":"2023-06-22","proceeding":null,"authors":["Shurong Chai","Rahul Kumar Jain","Shiyu Teng","Jiaqing Liu","Yinhao Li","Tomoko Tateyama","Yen-Wei Chen"],"abstract":"Recently, foundation models have been introduced demonstrating various tasks in the field of computer vision. These models such as Segment Anything Model (SAM) are generalized models trained using huge datasets. Currently, ongoing research focuses on exploring the effective utilization of these generalized models for specific domains, such as medical imaging. However, in medical imaging, the lack of training samples due to privacy concerns and other factors presents a major challenge for applying these generalized models to medical image segmentation task. To address this issue, the effective fine tuning of these models is crucial to ensure their optimal utilization. In this study, we propose to combine a complementary Convolutional Neural Network (CNN) along with the standard SAM network for medical image segmentation. To reduce the burden of fine tuning large foundation model and implement cost-efficient trainnig scheme, we focus only on fine-tuning the additional CNN network and SAM decoder part. This strategy significantly reduces trainnig time and achieves competitive results on publicly available dataset. The code is available at https://github.com/11yxk/SAM-LST.","url_abs":"https://arxiv.org/abs/2306.12737v1","url_pdf":"https://arxiv.org/pdf/2306.12737v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ladder-fine-tuning-approach-for-sam","repo_url":"https://github.com/11yxk/sam-lst","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"focus","method_name":"Focus"},{"method_slug":"sam","method_name":"SAM"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.12737","atlas_url":"https://app.syntology.ai/?focus=2306.12737","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.12737"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/11yxk/sam-lst","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"ran_fixture":3,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ad5471db7ab93cbf","entry":"calc_loss","repo":"11yxk/sam-lst","repo_kind":"official","path":"trainer.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/trainer.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ad5471db7ab93cbf"}},{"code_sha256_prefix":"733d7f0bedcb74c2","entry":"get_rel_pos","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/modeling_CNN/image_encoder.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/modeling_CNN/image_encoder.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"733d7f0bedcb74c2"}},{"code_sha256_prefix":"960b785e65a00358","entry":"random_rot_flip","repo":"11yxk/sam-lst","repo_kind":"official","path":"datasets/dataset_synapse.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/datasets/dataset_synapse.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"960b785e65a00358"}},{"code_sha256_prefix":"43fa66325ce3cafd","entry":"random_rotate","repo":"11yxk/sam-lst","repo_kind":"official","path":"datasets/dataset_synapse.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/datasets/dataset_synapse.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43fa66325ce3cafd"}},{"code_sha256_prefix":"105fa08885dc36cc","entry":"window_partition","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/modeling_CNN/image_encoder.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/modeling_CNN/image_encoder.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"105fa08885dc36cc"}},{"code_sha256_prefix":"50f37d517e2be27f","entry":"window_unpartition","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/modeling_CNN/image_encoder.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/modeling_CNN/image_encoder.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"50f37d517e2be27f"}},{"code_sha256_prefix":"d989416cca0adba7","entry":"build_sam_vit_b","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/build_sam.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/build_sam.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d989416cca0adba7"}},{"code_sha256_prefix":"4b02e5ca19e6ccd4","entry":"build_sam_vit_h","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/build_sam.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/build_sam.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b02e5ca19e6ccd4"}},{"code_sha256_prefix":"652f2a87b8537ea1","entry":"build_sam_vit_l","repo":"11yxk/sam-lst","repo_kind":"official","path":"segment_anything/build_sam.py","file_url":"https://github.com/11yxk/sam-lst/blob/HEAD/segment_anything/build_sam.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"652f2a87b8537ea1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}