Papers › Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution

Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution

3 Dec 2022arXiv:2212.01579archive 2025-07-28

Wentong Li, Wenyu Liu, Jianke Zhu, Miaomiao Cui, Risheng Yu, Xiansheng Hua, Lei Zhang

In contrast to fully supervised methods using pixel-wise mask labels, box-supervised instance segmentation takes advantage of simple box annotations, which has recently attracted increasing research attention. This paper presents a novel single-shot instance segmentation approach, namely Box2Mask, which integrates the classical level-set evolution model into deep neural network learning to achieve accurate mask prediction with only bounding box supervision. Specifically, both the input image and its deep features are employed to evolve the level-set curves implicitly, and a local consistency module based on a pixel affinity kernel is used to mine the local context and spatial relations. Two types of single-stage frameworks, i.e., CNN-based and transformer-based frameworks, are developed to empower the level-set evolution for box-supervised instance segmentation, and each framework consists of three essential components: instance-aware decoder, box-level matching assignment and level-set evolution. By minimizing the level-set energy function, the mask map of each instance can be iteratively optimized within its bounding box annotation. The experimental results on five challenging testbeds, covering general scenes, remote sensing, medical and scene text images, demonstrate the outstanding performance of our proposed Box2Mask approach for box-supervised instance segmentation. In particular, with the Swin-Transformer large backbone, our Box2Mask obtains 42.4% mask AP on COCO, which is on par with the recently developed fully mask-supervised methods. The code is available at: https://github.com/LiWentomng/boxlevelset.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

LiWentomng/BoxInstSeg officialmentioned on GitHubpytorch report
liwentomng/boxlevelset mentioned in papermentioned on GitHubApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Box-supervised Instance SegmentationDecoderInstance SegmentationSegmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Box-supervised Instance Segmentation COCO test-dev Box2Mask-T mask AP 42.4 #1 of 7 Archive leaderboard report
Box-supervised Instance Segmentation PASCAL VOC 2012 val Box2Mask-T AP_25 88.3 #1 of 5 Archive leaderboard report
Box-supervised Instance Segmentation PASCAL VOC 2012 val Box2Mask-T AP_50 77.2 #1 of 5 Archive leaderboard report
Box-supervised Instance Segmentation PASCAL VOC 2012 val Box2Mask-T AP_70 57.8 #1 of 5 Archive leaderboard report
Box-supervised Instance Segmentation PASCAL VOC 2012 val Box2Mask-T AP_75 51.1 #1 of 5 Archive leaderboard report
Box-supervised Instance Segmentation PASCAL VOC 2012 val Box2Mask-T mask AP 48.9 #1 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections