Papers › Where are the Masks: Instance Segmentation with Image-level Supervision

Where are the Masks: Instance Segmentation with Image-level Supervision

2 Jul 2019arXiv:1907.01430archive 2025-07-28

Issam H. Laradji, David Vazquez, Mark Schmidt

A major obstacle in instance segmentation is that existing methods often need many per-pixel labels in order to be effective. These labels require large human effort and for certain applications, such labels are not readily available. To address this limitation, we propose a novel framework that can effectively train with image-level labels, which are significantly cheaper to acquire. For instance, one can do an internet search for the term "car" and obtain many images where a car is present with minimal effort. Our framework consists of two stages: (1) train a classifier to generate pseudo masks for the objects of interest; (2) train a fully supervised Mask R-CNN on these pseudo masks. Our two main contribution are proposing a pipeline that is simple to implement and is amenable to different segmentation methods; and achieves new state-of-the-art results for this problem setup. Our results are based on evaluating our method on PASCAL VOC 2012, a standard dataset for weakly supervised methods, where we demonstrate major performance gains compared to existing methods with respect to mean average precision.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

ElementAI/wise_ils mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image-level Supervised Instance SegmentationInstance SegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WISE mAP@0.25 49.2 #9 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WISE mAP@0.5 41.7 #9 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WISE mAP@0.75 23.7 #9 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionMask R-CNNRPNRoIAlignSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections