Papers › Interactive Object Segmentation With Inside-Outside Guidance

Interactive Object Segmentation With Inside-Outside Guidance

1 Jun 2020CVPR 2020 6archive 2025-07-28

Shiyin Zhang, Jun Hao Liew, Yunchao Wei, Shikui Wei, Yao Zhao

This paper explores how to harvest precise object segmentation masks while minimizing the human interaction cost. To achieve this, we propose an Inside-Outside Guidance (IOG) approach in this work. Concretely, we leverage an inside point that is clicked near the object center and two outside points at the symmetrical corner locations (top-left and bottom-right or top-right and bottom-left) of a tight bounding box that encloses the target object. This results in a total of one foreground click and four background clicks for segmentation. The advantages of our IOG is four-fold: 1) the two outside points can help to remove distractions from other objects or background; 2) the inside point can help to eliminate the unrelated regions inside the bounding box; 3) the inside and outside points are easily identified, reducing the confusion raised by the state-of-the-art DEXTR in labeling some extreme samples; 4) our approach naturally supports additional clicks annotations for further correction. Despite its simplicity, our IOG not only achieves state-of-the-art performance on several popular benchmarks, but also demonstrates strong generalization capability across different domains such as street scenes, aerial imagery and medical images, without fine-tuning. In addition, we also propose a simple two-stage solution that enables our IOG to produce high quality instance segmentation masks from existing datasets with off-the-shelf bounding boxes such as ImageNet and Open Images, demonstrating the superiority of our IOG as an annotation tool.

PaperPDFCode

Code

shiyinzhang/Inside-Outside-Guidance officialmentioned in paperpytorch report
shiyinzhang/Pixel-ImageNet officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationInteractive SegmentationObjectSegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Interactive Segmentation COCO (Common Objects in Context) IOG Instance Average IoU 85.2 #1 of 1 Archive leaderboard report
Interactive Segmentation Cityscapes val IOG Instance Average IoU 83.8 #1 of 1 Archive leaderboard report
Interactive Segmentation PASCAL2COCO(Unseen) IOG Instance Average IoU 82.1 #1 of 1 Archive leaderboard report
Interactive Segmentation Rooftop IOG Instance Average IoU 94.0 #1 of 2 Archive leaderboard report
Interactive Segmentation ssTEM IOG Instance Average IoU 83.7 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionDEXTRDilated ConvolutionGlobal Average PoolingKaiming InitializationMax PoolingPyramid Pooling ModuleReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections