Papers › Revisiting the Sibling Head in Object Detector

Revisiting the Sibling Head in Object Detector

17 Mar 2020CVPR 2020 6arXiv:2003.07540archive 2025-07-28

Guanglu Song, Yu Liu, Xiaogang Wang

The ``shared head for classification and localization'' (sibling head), firstly denominated in Fast RCNN~\cite{girshick2015fast}, has been leading the fashion of the object detection community in the past five years. This paper provides the observation that the spatial misalignment between the two object functions in the sibling head can considerably hurt the training process, but this misalignment can be resolved by a very simple operator called task-aware spatial disentanglement (TSD). Considering the classification and regression, TSD decouples them from the spatial dimension by generating two disentangled proposals for them, which are estimated by the shared proposal. This is inspired by the natural insight that for one instance, the features in some salient area may have rich information for classification while these around the boundary may be good at bounding box regression. Surprisingly, this simple design can boost all backbones and models on both MS COCO and Google OpenImage consistently by ~3% mAP. Further, we propose a progressive constraint to enlarge the performance margin between the disentangled and the shared proposals, and gain ~1% more mAP. We show the \algname{} breaks through the upper bound of nowadays single-model detector by a large margin (mAP 49.4 with ResNet-101, 51.2 with SENet154), and is the core model of our 1st place solution on the Google OpenImage Challenge 2019.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Sense-X/TSD mentioned on GitHubpytorchApache-2.0 report
wsx66848/tsd mentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DisentanglementGeneral ClassificationObjectObject Detectionobject-detectionregression

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) AP50 71.9 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) AP75 56.0 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) APL 64.2 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) APM 54.8 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) APS 33.8 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(SENet154-DCN,multi-scale) box mAP 51.2 #82 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) AP50 69.6 #94 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) AP75 54.4 #94 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) APL 61.0 #94 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) APM 52.5 #94 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) APS 32.7 #94 of 225 Archive leaderboard report
Object Detection COCO test-dev TSD(ResNet-101-Deformable, Image Pyramid) box mAP 49.4 #94 of 225 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionGlobal Average PoolingKaiming InitializationMax PoolingRandom Horizontal FlipReLUResidual BlockResidual ConnectionRoIAlignSGD with MomentumWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections