{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tool-detection-and-operative-skill-assessment","title":"Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networks","arxiv_id":"1802.08774","date":"2018-02-24","proceeding":null,"authors":["Amy Jin","Serena Yeung","Jeffrey Jopling","Jonathan Krause","Dan Azagury","Arnold Milstein","Li Fei-Fei"],"abstract":"Five billion people in the world lack access to quality surgical care.\nSurgeon skill varies dramatically, and many surgical patients suffer\ncomplications and avoidable harm. Improving surgical training and feedback\nwould help to reduce the rate of complications, half of which have been shown\nto be preventable. To do this, it is essential to assess operative skill, a\nprocess that currently requires experts and is manual, time consuming, and\nsubjective. In this work, we introduce an approach to automatically assess\nsurgeon performance by tracking and analyzing tool movements in surgical\nvideos, leveraging region-based convolutional neural networks. In order to\nstudy this problem, we also introduce a new dataset, m2cai16-tool-locations,\nwhich extends the m2cai16-tool dataset with spatial bounds of tools. While\nprevious methods have addressed tool presence detection, ours is the first to\nnot only detect presence but also spatially localize surgical tools in\nreal-world laparoscopic surgical videos. We show that our method both\neffectively detects the spatial bounds of tools as well as significantly\noutperforms existing methods on tool presence detection. We further demonstrate\nthe ability of our method to assess surgical quality through analysis of tool\nusage patterns, movement range, and economy of motion.","url_abs":"http://arxiv.org/abs/1802.08774v2","url_pdf":"http://arxiv.org/pdf/1802.08774v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tool-detection-and-operative-skill-assessment","repo_url":"https://github.com/camma-public/ssg-qa","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"tool-detection-and-operative-skill-assessment","repo_url":"https://github.com/camma-public/ssg-vqa","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[],"methods":[],"datasets_introduced":[{"slug":"m2cai16-tool-locations","name":"m2cai16-tool-locations","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1802.08774","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}