Papers › Cut and Learn for Unsupervised Object Detection and Instance Segmentation

Cut and Learn for Unsupervised Object Detection and Instance Segmentation

26 Jan 2023CVPR 2023 1arXiv:2301.11320archive 2025-07-28

Xudong Wang, Rohit Girdhar, Stella X. Yu, Ishan Misra

We propose Cut-and-LEaRn (CutLER), a simple approach for training unsupervised object detection and segmentation models. We leverage the property of self-supervised models to 'discover' objects without supervision and amplify it to train a state-of-the-art localization model without any human labels. CutLER first uses our proposed MaskCut approach to generate coarse masks for multiple objects in an image and then learns a detector on these masks using our robust loss function. We further improve the performance by self-training the model on its predictions. Compared to prior work, CutLER is simpler, compatible with different detection architectures, and detects multiple objects. CutLER is also a zero-shot unsupervised detector and improves detection performance AP50 by over 2.7 times on 11 benchmarks across domains like video frames, paintings, sketches, etc. With finetuning, CutLER serves as a low-shot detector surpassing MoCo-v2 by 7.3% APbox and 6.6% APmask on COCO when training with 5% labels.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

facebookresearch/cutler officialmentioned in papermentioned on GitHubpytorchNOASSERTION report
u2seg/u2seg mentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationObject DetectionSemantic SegmentationUnsupervised Instance SegmentationUnsupervised Object DetectionUnsupervised Panoptic SegmentationUnsupervised Zero-Shot Instance Segmentationobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Instance Segmentation COCO val2017 CutLER (Cascade+DINO) AP 9.2 #2 of 5 Archive leaderboard report
Unsupervised Instance Segmentation COCO val2017 CutLER (Cascade+DINO) AP50 18.9 #2 of 5 Archive leaderboard report
Unsupervised Instance Segmentation COCO val2017 CutLER (Cascade+DINO) AP75 9.7 #2 of 5 Archive leaderboard report
Unsupervised Instance Segmentation UVO CutLER (Cascade+DINO) AP 10.1 #1 of 1 Archive leaderboard report
Unsupervised Instance Segmentation UVO CutLER (Cascade+DINO) AP50 22.8 #1 of 1 Archive leaderboard report
Unsupervised Instance Segmentation UVO CutLER (Cascade+DINO) AP75 8 #1 of 1 Archive leaderboard report
Unsupervised Panoptic Segmentation COCO val2017 CutLER+STEGO PQ 12.4 #2 of 2 Archive leaderboard report
Unsupervised Panoptic Segmentation COCO val2017 CutLER+STEGO RQ 15.2 #2 of 2 Archive leaderboard report
Unsupervised Panoptic Segmentation COCO val2017 CutLER+STEGO SQ 36.1 #2 of 2 Archive leaderboard report
Unsupervised Zero-Shot Instance Segmentation COCO val2017 CutLER AP 5.3 #2 of 2 Archive leaderboard report
Unsupervised Zero-Shot Instance Segmentation COCO val2017 CutLER AP50 8.6 #2 of 2 Archive leaderboard report
Unsupervised Zero-Shot Instance Segmentation COCO val2017 CutLER AP75 5.5 #2 of 2 Archive leaderboard report
Unsupervised Zero-Shot Instance Segmentation COCO val2017 CutLER AR100 9.3 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections