Papers › Is Heuristic Sampling Necessary in Training Deep Object Detectors?

Is Heuristic Sampling Necessary in Training Deep Object Detectors?

11 Sep 2019arXiv:1909.04868archive 2025-07-28

Joya Chen, Dong Liu, Tong Xu, Shiwei Wu, Yifei Cheng, Enhong Chen

To train accurate deep object detectors under the extreme foreground-background imbalance, heuristic sampling methods are always necessary, which either re-sample a subset of all training samples (hard sampling methods, \eg biased sampling, OHEM), or use all training samples but re-weight them discriminatively (soft sampling methods, \eg Focal Loss, GHM). In this paper, we challenge the necessity of such hard/soft sampling methods for training accurate deep object detectors. While previous studies have shown that training detectors without heuristic sampling methods would significantly degrade accuracy, we reveal that this degradation comes from an unreasonable classification gradient magnitude caused by the imbalance, rather than a lack of re-sampling/re-weighting. Motivated by our discovery, we propose a simple yet effective \emph{Sampling-Free} mechanism to achieve a reasonable classification gradient magnitude by initialization and loss scaling. Unlike heuristic sampling methods with multiple hyperparameters, our Sampling-Free mechanism is fully data diagnostic, without laborious hyperparameters searching. We verify the effectiveness of our method in training anchor-based and anchor-free object detectors, where our method always achieves higher detection accuracy than heuristic sampling methods on COCO and PASCAL VOC datasets. Our Sampling-Free mechanism provides a new perspective to address the foreground-background imbalance. Our code is released at \url{https://github.com/ChenJoya/sampling-free}.

PaperPDFCode

Code

14 repositories listed; official and paper-mentioned ones first.

ChenJoya/objnessdet officialmentioned in papermentioned on GitHubpytorch report
ChenJoya/sampling-free officialmentioned in papermentioned on GitHubpytorch report
facebookresearch/maskrcnn-benchmark officialmentioned in papermentioned on GitHubpytorchMIT report
FluteXu/ms-project mentioned on GitHubpytorch report
GuoLiuFang/maskrcnn-benchmark-lfs mentioned on GitHubpytorchMIT report
SilvioGiancola/maskrcnn-benchmark mentioned on GitHubpytorchMIT report
Zhang-Jing-Xuan/MaskRCNN mentioned on GitHubpytorchnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-ready report
banben/maskrcnn-benchmark mentioned on GitHubpytorchMIT report
basaltzhang/maskrcnn-benchmark mentioned on GitHubpytorchMIT report
ccchang1023/maskrcnn-benchmark mentioned on GitHubpytorchMIT report
cyctrung/DPnet mentioned on GitHubpytorchMIT report
jonvthvn90/Project mentioned on GitHubpytorchMIT report
markson14/WheatDet mentioned on GitHubpytorchMIT report
ryota2425/maskrcnn-benchmark mentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DiagnosticGeneral ClassificationInstance SegmentationObjectSemantic Segmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Focal Loss

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections