Papers › Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance...

Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentation

6 Apr 2021CVPR 2021 1arXiv:2104.05606archive 2025-07-28

Minghan Li, Shuai Li, Lida Li, Lei Zhang

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location. Second, a video is directly divided into individual frames for frame-level instance segmentation, ignoring the temporal correlation between adjacent frames. To address these issues, we propose a simple yet effective one-stage video instance segmentation framework by spatial calibration and temporal fusion, namely STMask. To ensure spatial feature calibration with ground-truth bounding boxes, we first predict regressed bounding boxes around ground-truth bounding boxes, and extract features from them for frame-level instance segmentation. To further explore temporal correlation among video frames, we aggregate a temporal fusion module to infer instance masks from each frame to its adjacent frames, which helps our framework to handle challenging videos such as motion blur, partial occlusion and unusual object-to-camera poses. Experiments on the YouTube-VIS valid set show that the proposed STMask with ResNet-50/-101 backbone obtains 33.5 % / 36.8 % mask AP, while achieving 28.6 / 23.4 FPS on video instance segmentation. The code is released online https://github.com/MinghanLi/STMask.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

MinghanLi/STMask officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationSegmentationSemantic SegmentationVideo Instance Segmentation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) AP50 35.4 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) AP75 15.2 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) APho 23.7 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) APmo 14.7 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) APso 11.1 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) AR1 8.4 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) AR10 23.1 #38 of 44 Archive leaderboard report
Video Instance Segmentation OVIS validation STMask(R101-DCN-FPN) mask AP 17.3 #38 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS 2021 STMask(R101-DCN-FPN) AP50 54.0 #26 of 26 Archive leaderboard report
Video Instance Segmentation YouTube-VIS 2021 STMask(R101-DCN-FPN) AP75 38.0 #26 of 26 Archive leaderboard report
Video Instance Segmentation YouTube-VIS 2021 STMask(R101-DCN-FPN) AR1 29.4 #26 of 26 Archive leaderboard report
Video Instance Segmentation YouTube-VIS 2021 STMask(R101-DCN-FPN) AR10 39.1 #26 of 26 Archive leaderboard report
Video Instance Segmentation YouTube-VIS 2021 STMask(R101-DCN-FPN) mask AP 34.6 #26 of 26 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation STMask(R101-DCN-FPN) AP50 56.8 #27 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation STMask(R101-DCN-FPN) AP75 38.0 #27 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation STMask(R101-DCN-FPN) AR1 34.8 #27 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation STMask(R101-DCN-FPN) AR10 41.8 #27 of 44 Archive leaderboard report
Video Instance Segmentation YouTube-VIS validation STMask(R101-DCN-FPN) mask AP 36.8 #27 of 44 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections