Browse State-of-the-Art › Surgical phase recognition
Surgical phase recognition
31 papers with code · 4 benchmarks · 8 datasets archive 2025-07-28
The first 40 videos are used for training, the last 40 videos are used for testing.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Cholec80 (6 rows) | LoViT | LoViT: Long Video Transformer for Surgical Phase Recognition | code | — | Compare |
| HeiChole Benchmark (5 rows) | MuST | MuST: Multi-Scale Transformers for Surgical Phase Recognition | code | — | Compare |
| MISAW (3 rows) | MuST | MuST: Multi-Scale Transformers for Surgical Phase Recognition | code | — | Compare |
| GraSP (2 rows) | MuST | MuST: Multi-Scale Transformers for Surgical Phase Recognition | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
8 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 69 · with a code link: 31 · where Syntology ran a sample: 2 (2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 69 tagged: 2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 69 of 69, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
20 Jan 2024 3 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 6 pointer-only (licence)To exploit our proposed benchmark, we introduce the Transformers for Actions, Phases, Steps, and Instrument Segmentation (TAPIS) model, a general architecture that combines a global video feature extractor with…
-
16 May 2024 2 repositories listedBy disentangling embedding spaces of different hierarchical levels, the learned multi-modal representations encode short-term and long-term surgical concepts in the same model.
-
10 Jul 2021 2 repositories listedTo address the problem, we propose a new non end-to-end training strategy and explore different designs of multi-stage architecture for surgical phase recognition task.
-
24 Mar 2020 2 repositories listedAutomatic surgical phase recognition is a challenging and crucial task with the potential to improve patient safety and become an integral part of intra-operative decision-support systems.
-
25 Mar 2025 1 repository listedOur experimental results show that SurgFM outperforms state-of-the-art models in multiple downstream tasks, including significant gains in surgical phase recognition (+8.
-
26 Feb 2025 1 repository listedFirst, to mitigate computational inefficiencies, we propose the EndoMamba backbone, optimized for real-time inference.
-
29 Jan 2025 1 repository listedAccurate surgical phase recognition is crucial for advancing computer-assisted interventions, yet the scarcity of labeled data hinders training reliable deep learning models.
-
19 Sep 2024 1 repository listedTo ensure a global understanding of the surgical procedure, we devise a phase localization strategy for SurgPLAN++ to predict phase segments across the entire video through phase proposals.
-
18 Sep 2024 1 repository listedEndoscopic Submucosal Dissection (ESD) is a minimally invasive procedure initially developed for early gastric cancer treatment and has expanded to address diverse gastrointestinal lesions.
-
10 Sep 2024 1 repository listedIn the other stream, DACAT fine-tunes a new frame encoder to extract the frame-wise feature at the current moment.
-
Surgformer: Surgical Transformer with Hierarchical Temporal Attention for Surgical Phase Recognition7 Aug 2024 1 repository listedMoreover, we propose a novel Hierarchical Temporal Attention (HTA) to capture both global and local information within varied temporal resolutions from a target frame-centric perspective.
-
24 Jul 2024 1 repository listedPhase recognition in surgical videos is crucial for enhancing computer-aided surgical systems as it enables automated understanding of sequential procedural stages.
-
11 Jul 2024 1 repository listedInspired by the recent success of Mamba, a state space model with linear scalability in sequence length, this paper presents SR-Mamba, a novel attention-free model specifically tailored to meet the challenges of…
-
30 May 2024 1 repository listedTo address this issue, we introduce a new egocentric open surgery video dataset for phase recognition, named EgoSurgery-Phase.
-
11 Dec 2023 1 repository listedRecently, spatiotemporal graphs have emerged as a concise and elegant manner of representing video clips in an object-centric fashion, and have shown to be useful for downstream tasks such as action recognition.
-
23 Aug 2023 1 repository listedTo fully exploit the power of SSL, we create sizable unlabeled endoscopic video datasets for training MSNs.
-
19 Jul 2023 1 repository listedIn addition, we propose to train the feature extractor, a standard CNN, together with an LSTM on preferably long video segments, i. e., with long temporal context.
-
23 May 2023 1 repository listedSurgical phase recognition is a basic component for different context-aware applications in computer- and robot-assisted surgery.
-
15 May 2023 1 repository listedOur results demonstrate the effectiveness of our approach in achieving state-of-the-art performance of surgical phase recognition on two datasets of different surgical procedures and temporal sequencing characteristics…
-
30 Mar 2023 1 repository listedIn this work, we investigate the need for endoscopy domain-specific pretraining based on downstream objectives.
-
1 Jan 2023 1 repository listedWe highlight that the inference time of SKiT is constant, and independent from the input length, making it a stable choice for keeping a record of important global information, that appears on long surgical videos…
-
8 Dec 2022 1 repository listedSecond, we present Transformers for Action, Phase, Instrument, and steps Recognition (TAPIR) as a strong baseline for surgical scene understanding.
-
1 Jul 2022 1 repository listedCorrect transfer of these methods to surgery, as described and conducted in this work, leads to substantial performance gains over generic uses of SSL - up to 7.
-
19 May 2022 1 repository listedOur key insight is to distill knowledge from publicly available models trained on large generic datasets4 to facilitate the self-supervised learning of surgical videos.
-
16 Feb 2022 1 repository listedOur study uncovers unique insights of surgical phase recognition with timestamp supervisions: 1) timestamp annotation can reduce 74% annotation time compared with the full annotation, and surgeons tend to annotate those…
-
22 Nov 2021 1 repository listedAutomatic surgical phase recognition plays a vital role in robot-assisted surgeries.
-
2 Jul 2021 1 repository listedIn particular, we propose (I) an end-to-end recurrent neural network to recognize the lens-implantation phase and (II) a novel semantic segmentation network to segment the lens and pupil after the implantation phase.
-
17 Mar 2021 1 repository listedIn this paper, we introduce, for the first time in surgical workflow analysis, Transformer to reconsider the ignored complementary effects of spatial and temporal features for accurate surgical phase recognition.
-
13 Jul 2019 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Mutually leveraging both low-level feature sharing and high-level prediction correlating, our MTRCNet-CL method can encourage the interactions between the two tasks to a large extent, and hence can bring about benefits…
-
30 Nov 2018 1 repository listedVision algorithms capable of interpreting scenes from a real-time video stream are necessary for computer-assisted surgery systems to achieve context-aware behavior.
-
18 Jun 2018 1 repository listed
-
Holistic Surgical Phase Recognition with Hierarchical Input Dependent State Space Models26 Jun 2025 0 repositories listed
-
Recognizing Surgical Phases Anywhere: Few-Shot Test-time Adaptation and Task-graph Guided Refinement25 Jun 2025 0 repositories listed
-
Meta-SurDiff: Classification Diffusion Model Optimized by Meta Learning is Reliable for Online Surgical Phase Recognition17 Jun 2025 0 repositories listed
-
ReSW-VL: Representation Learning for Surgical Workflow Analysis Using Vision-Language Model19 May 2025 0 repositories listed
-
Surgeons vs. Computer Vision: A comparative analysis on surgical phase recognition capabilities26 Apr 2025 0 repositories listed
-
Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025 0 repositories listed
-
fine-CLIP: Enhancing Zero-Shot Fine-Grained Surgical Action Recognition with Vision-Language Models25 Mar 2025 0 repositories listed
-
MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognition2 Mar 2025 0 repositories listed
-
ArthroPhase: A Novel Dataset and Method for Phase Recognition in Arthroscopic Video11 Feb 2025 0 repositories listed
-
Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomy5 Dec 2024 0 repositories listed
-
Neural Finite-State Machines for Surgical Phase Recognition27 Nov 2024 0 repositories listed
-
Towards Robust Algorithms for Surgical Phase Recognition via Digital Twin-based Scene Representation26 Oct 2024 0 repositories listed
-
SurgPETL: Parameter-Efficient Image-to-Surgical-Video Transfer Learning for Surgical Phase Recognition30 Sep 2024 0 repositories listed
-
VidLPRO: A Video-Language Pre-training Framework for Robotic and Laparoscopic Surgery7 Sep 2024 0 repositories listed
-
Robust Surgical Phase Recognition From Annotation Efficient Supervision26 Jun 2024 0 repositories listed
-
Towards Intelligent Speech Assistants in Operating Rooms: A Multimodal Model for Surgical Workflow Analysis17 Jun 2024 0 repositories listed
-
Thoracic Surgery Video Analysis for Surgical Phase Recognition13 Jun 2024 0 repositories listed
-
SuPRA: Surgical Phase Recognition and Anticipation for Intra-Operative Planning10 Mar 2024 0 repositories listed
-
Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition22 Jan 2024 0 repositories listed
-
Surgical Temporal Action-aware Network with Sequence Regularization for Phase Recognition21 Nov 2023 0 repositories listed
-
SurgPLAN: Surgical Phase Localization Network for Phase Recognition16 Nov 2023 0 repositories listed
-
Weakly-Supervised Surgical Phase Recognition26 Oct 2023 0 repositories listed
-
Self-Knowledge Distillation for Surgical Phase Recognition15 Jun 2023 0 repositories listed
-
15 Jun 2023 0 repositories listed
-
Pelphix: Surgical Phase Recognition from X-ray Images in Percutaneous Pelvic Fixation18 Apr 2023 0 repositories listed
-
ARST: Auto-Regressive Surgical Transformer for Phase Recognition from Laparoscopic Videos2 Sep 2022 0 repositories listed
-
Surgical Phase Recognition in Laparoscopic Cholecystectomy14 Jun 2022 0 repositories listed
-
Quantification of Robotic Surgeries with Vision-Based Deep Learning6 May 2022 0 repositories listed
-
Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases14 Mar 2022 0 repositories listed
-
Rethinking Generalization Performance of Surgical Phase Recognition with Expert-Generated Annotations22 Oct 2021 0 repositories listed
-
30 Sep 2021 0 repositories listed
-
OperA: Attention-Regularized Transformers for Surgical Phase Recognition5 Mar 2021 0 repositories listed
-
Aggregating Long-Term Context for Learning Laparoscopic and Robot-Assisted Surgical Workflows1 Sep 2020 0 repositories listed
-
Unsupervised Temporal Video Segmentation as an Auxiliary Task for Predicting the Remaining Surgery Duration26 Feb 2020 0 repositories listed
-
Surgical Phase Recognition of Short Video Shots Based on Temporal Modeling of Deep Features20 Jul 2018 0 repositories listed
-
DeepPhase: Surgical Phase Recognition in CATARACTS Videos17 Jul 2018 0 repositories listed
-
Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networks22 May 2018 0 repositories listed
-
Single- and Multi-Task Architectures for Surgical Workflow Challenge at M2CAI 201627 Oct 2016 0 repositories listed
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections