Papers › ISDA: Position-Aware Instance Segmentation with Deformable Attention

ISDA: Position-Aware Instance Segmentation with Deformable Attention

23 Feb 2022arXiv:2202.12251archive 2025-07-28

Kaining Ying, Zhenhua Wang, Cong Bai, Pengfei Zhou

Most instance segmentation models are not end-to-end trainable due to either the incorporation of proposal estimation (RPN) as a pre-processing or non-maximum suppression (NMS) as a post-processing. Here we propose a novel end-to-end instance segmentation method termed ISDA. It reshapes the task into predicting a set of object masks, which are generated via traditional convolution operation with learned position-aware kernels and features of objects. Such kernels and features are learned by leveraging a deformable attention network with multi-scale representation. Thanks to the introduced set-prediction mechanism, the proposed method is NMS-free. Empirically, ISDA outperforms Mask R-CNN (the strong baseline) by 2.6 points on MS-COCO, and achieves leading performance compared with recent models. Code will be available soon.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

yingkaining/isda officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationSegmentationSemantic Segmentation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Instance Segmentation COCO test-dev ISDA (ours) AP50 62 #84 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ISDA (ours) AP75 41.1 #84 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ISDA (ours) APM 41.2 #84 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ISDA (ours) APS 17 #84 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ISDA (ours) mask AP 38.7 #84 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ISDA (ResNet-50) APL 55.7 #112 of 112 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionMask R-CNNRPNRoIAlignSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections