Papers › MSN: Efficient Online Mask Selection Network for Video Instance Segmentation
MSN: Efficient Online Mask Selection Network for Video Instance Segmentation
Vidit Goel, Jiachen Li, Shubhika Garg, Harsh Maheshwari, Humphrey Shi
In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from segmentation and propagation branches in an online manner using the Mask Selection Network (MSN) hence limiting the noise accumulation during mask tracking. We propose an effective design of MSN by using patch-based convolutional neural network. The network is able to distinguish between very subtle differences between the masks and choose the better masks out of the associated masks accurately. Further, we make use of temporal consistency and process the video sequences in both forward and reverse manner as a post processing step to recover lost objects. The proposed method can be used to adapt any video object segmentation method for the task of VIS. Our method achieves a score of 49.1 mAP on 2021 YouTube-VIS Challenge and was ranked third place among more than 30 global teams. Our code will be available at https://github.com/SHI-Labs/Mask-Selection-Networks.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Instance Segmentation | YouTube-VIS validation | MSN | AP50 | 69.4 | #18 of 44 | Archive leaderboard | report |
| Video Instance Segmentation | YouTube-VIS validation | MSN | AP75 | 54.9 | #18 of 44 | Archive leaderboard | report |
| Video Instance Segmentation | YouTube-VIS validation | MSN | AR1 | 40.1 | #18 of 44 | Archive leaderboard | report |
| Video Instance Segmentation | YouTube-VIS validation | MSN | AR10 | 55.0 | #18 of 44 | Archive leaderboard | report |
| Video Instance Segmentation | YouTube-VIS validation | MSN | mask AP | 48.8 | #18 of 44 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections