{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ai-sam-automatic-and-interactive-segment","title":"AI-SAM: Automatic and Interactive Segment Anything Model","arxiv_id":"2312.03119","date":"2023-12-05","proceeding":null,"authors":["Yimu Pan","Sitao Zhang","Alison D. Gernand","Jeffery A. Goldstein","James Z. Wang"],"abstract":"Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as pre-trained models. However, current adaptation strategies for these models tend to lean towards either automatic or interactive approaches. Interactive methods depend on prompts user input to operate, while automatic ones bypass the interactive promptability entirely. Addressing these limitations, we introduce a novel paradigm and its first model: the Automatic and Interactive Segment Anything Model (AI-SAM). In this paradigm, we conduct a comprehensive analysis of prompt quality and introduce the pioneering Automatic and Interactive Prompter (AI-Prompter) that automatically generates initial point prompts while accepting additional user inputs. Our experimental results demonstrate AI-SAM's effectiveness in the automatic setting, achieving state-of-the-art performance. Significantly, it offers the flexibility to incorporate additional user prompts, thereby further enhancing its performance. The project page is available at https://github.com/ymp5078/AI-SAM.","url_abs":"https://arxiv.org/abs/2312.03119v1","url_pdf":"https://arxiv.org/pdf/2312.03119v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ai-sam-automatic-and-interactive-segment","repo_url":"https://github.com/ymp5078/ai-sam","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/medical-image-segmentation-on-automatic","task":"Medical Image Segmentation","dataset":"Automatic Cardiac Diagnosis Challenge (ACDC)","model":"Interactive AI-SAM gt box","rank_in_archive_order":2,"of":20,"metrics":{"Avg DSC":"93.89"},"uses_additional_data":true},{"leaderboard":"/sota/medical-image-segmentation-on-automatic","task":"Medical Image Segmentation","dataset":"Automatic Cardiac Diagnosis Challenge (ACDC)","model":"Automatic AI-SAM","rank_in_archive_order":10,"of":20,"metrics":{"Avg DSC":"92.06"},"uses_additional_data":true},{"leaderboard":"/sota/medical-image-segmentation-on-synapse-multi","task":"Medical Image Segmentation","dataset":"Synapse multi-organ CT","model":"Interactive AI-SAM gt box","rank_in_archive_order":1,"of":23,"metrics":{"Avg DSC":"90.66"},"uses_additional_data":true},{"leaderboard":"/sota/medical-image-segmentation-on-synapse-multi","task":"Medical Image Segmentation","dataset":"Synapse multi-organ CT","model":"Automatic AI-SAM","rank_in_archive_order":10,"of":23,"metrics":{"Avg DSC":"84.21"},"uses_additional_data":true}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2312.03119","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}