Papers › Point Segment and Count: A Generalized Framework for Object Counting

Point Segment and Count: A Generalized Framework for Object Counting

1 Jan 2024CVPR 2024 1archive 2025-07-28

Zhizhong Huang, Mingliang Dai, Yi Zhang, Junping Zhang, Hongming Shan

Class-agnostic object counting aims to count all objects in an image with respect to example boxes or class names a.k.a few-shot and zero-shot counting. In this paper we propose a generalized framework for both few-shot and zero-shot object counting based on detection. Our framework combines the superior advantages of two foundation models without compromising their zero-shot capability: (i) SAM to segment all possible objects as mask proposals and (ii) CLIP to classify proposals to obtain accurate object counts. However this strategy meets the obstacles of efficiency overhead and the small crowded objects that cannot be localized and distinguished. To address these issues our framework termed PseCo follows three steps: point segment and count. Specifically we first propose a class-agnostic object localization to provide accurate but least point prompts for SAM which consequently not only reduces computation costs but also avoids missing small objects. Furthermore we propose a generalized object classification that leverages CLIP image/text embeddings as the classifier following a hierarchical knowledge distillation to obtain discriminative classifications among hierarchical mask proposals. Extensive experimental results on FSC-147 COCO and LVIS demonstrate that PseCo achieves state-of-the-art performance in both few-shot/zero-shot object counting/detection.

PaperPDFCode

Code

hzzone/pseco officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-shot Object Counting and DetectionKnowledge DistillationObjectObject CountingObject LocalizationZero-Shot Counting

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Few-shot Object Counting and Detection FSC147 PSECO AP(test) 42.98 #3 of 4 Archive leaderboard report
Few-shot Object Counting and Detection FSC147 PSECO AP50(test) 73.33 #3 of 4 Archive leaderboard report
Few-shot Object Counting and Detection FSC147 PSECO MAE(test) 13.05 #3 of 4 Archive leaderboard report
Few-shot Object Counting and Detection FSC147 PSECO RMSE(test) 112.86 #3 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

CLIPKnowledge DistillationSAM

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections