</> Code with Papers by Syntology

Papers › WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition

WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition

22 Feb 2024arXiv:2402.14812archive 2025-07-28

Lianghui Zhu, Junwei Zhou, Yan Liu, Xin Hao, Wenyu Liu, Xinggang Wang

Weakly supervised visual recognition using inexact supervision is a critical yet challenging learning problem. It significantly reduces human labeling costs and traditionally relies on multi-instance learning and pseudo-labeling. This paper introduces WeakSAM and solves the weakly-supervised object detection (WSOD) and segmentation by utilizing the pre-learned world knowledge contained in a vision foundation model, i.e., the Segment Anything Model (SAM). WeakSAM addresses two critical limitations in traditional WSOD retraining, i.e., pseudo ground truth (PGT) incompleteness and noisy PGT instances, through adaptive PGT generation and Region of Interest (RoI) drop regularization. It also addresses the SAM's problems of requiring prompts and category unawareness for automatic object detection and segmentation. Our results indicate that WeakSAM significantly surpasses previous state-of-the-art methods in WSOD and WSIS benchmarks with large margins, i.e. average improvements of 7.4% and 8.5%, respectively. The code is available at \url{https://github.com/hustvl/WeakSAM}.

PaperPDFCode

Code

hustvl/weaksam officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image-level Supervised Instance SegmentationObject DetectionSegmentationWeakly Supervised Object DetectionWorld Knowledgeobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask2Former (with SAM) AP 25.2 #1 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask2Former (with SAM) AP@50 38.4 #1 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask2Former (with SAM) AP@75 27.0 #1 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask RCNN (with SAM) AP 20.6 #2 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask RCNN (with SAM) AP@50 33.9 #2 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO 2017 val WeakSAM-Mask RCNN (with SAM) AP@75 22.0 #2 of 6 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask2Former (with SAM) AP 25.9 #1 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask2Former (with SAM) AP@50 39.9 #1 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask2Former (with SAM) AP@75 27.9 #1 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask RCNN (with SAM) AP 21.0 #2 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask RCNN (with SAM) AP@50 34.5 #2 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation COCO test-dev WeakSAM-Mask RCNN (with SAM) AP@75 22.2 #2 of 7 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask2Former (with SAM) mAP@0.25 73.4 #1 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask2Former (with SAM) mAP@0.5 64.4 #1 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask2Former (with SAM) mAP@0.7 49.7 #1 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask2Former (with SAM) mAP@0.75 45.3 #1 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask RCNN (with SAM) mAP@0.25 70.3 #2 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask RCNN (with SAM) mAP@0.5 59.6 #2 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask RCNN (with SAM) mAP@0.7 43.1 #2 of 13 Archive leaderboard report
Image-level Supervised Instance Segmentation PASCAL VOC 2012 val WeakSAM-Mask RCNN (with SAM) mAP@0.75 36.2 #2 of 13 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-MIST-DINO (with SAM) AP 26.6 #1 of 7 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-OICR-DINO (with SAM) AP 24.9 #2 of 7 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-MIST-Faster RCNN (with SAM) AP 23.8 #3 of 7 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-MIST (with SAM) AP 22.9 #4 of 7 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-OICR-Faster RCNN (with SAM) AP 22.3 #5 of 7 Archive leaderboard report
Weakly Supervised Object Detection MS-COCO-2014 WeakSAM-OICR (with SAM) AP 19.9 #6 of 7 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-MIST-DINO (with SAM) MAP 73.4 #1 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-MIST-Faster RCNN (with SAM) MAP 71.8 #2 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-MIST (with SAM) MAP 67.4 #3 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-OICR-DINO (with SAM) MAP 66.1 #4 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-OICR-Faster RCNN (with SAM) MAP 65.7 #5 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2007 WeakSAM-OICR (with SAM) MAP 58.9 #6 of 41 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-MIST-DINO (with SAM) MAP 70.2 #1 of 32 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-MIST-Faster RCNN (with SAM) MAP 69.2 #2 of 32 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-MIST (with SAM) MAP 66.9 #3 of 32 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-OICR-DINO (with SAM) MAP 63.7 #4 of 32 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-OICR-Faster RCNN (with SAM) MAP 62.9 #5 of 32 Archive leaderboard report
Weakly Supervised Object Detection PASCAL VOC 2012 test WeakSAM-OICR (with SAM) MAP 58.4 #6 of 32 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections