Papers › LIP: Local Importance-based Pooling

LIP: Local Importance-based Pooling

12 Aug 2019ICCV 2019 10arXiv:1908.04156archive 2025-07-28

Ziteng Gao, Li-Min Wang, Gangshan Wu

Spatial downsampling layers are favored in convolutional neural networks (CNNs) to downscale feature maps for larger receptive fields and less memory consumption. However, for discriminative tasks, there is a possibility that these layers lose the discriminative details due to improper pooling strategies, which could hinder the learning process and eventually result in suboptimal models. In this paper, we present a unified framework over the existing downsampling layers (e.g., average pooling, max pooling, and strided convolution) from a local importance view. In this framework, we analyze the issues of these widely-used pooling layers and figure out the criteria for designing an effective downsampling layer. According to this analysis, we propose a conceptually simple, general, and effective pooling layer based on local importance modeling, termed as {\em Local Importance-based Pooling} (LIP). LIP can automatically enhance discriminative features during the downsampling procedure by learning adaptive importance weights based on inputs. Experiment results show that LIP consistently yields notable gains with different depths and different architectures on ImageNet classification. In the challenging MS COCO dataset, detectors with our LIP-ResNets as backbones obtain a consistent improvement (≥1.4%) over the vanilla ResNets, and especially achieve the current state-of-the-art performance in detecting small objects under the single-scale testing scheme.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

sebgao/LIP officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image ClassificationObject Detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification ImageNet LIP-ResNet-101 Number of params 42.9M #764 of 1060 Archive leaderboard report
Image Classification ImageNet LIP-ResNet-101 Top 1 Accuracy 79.33% #764 of 1060 Archive leaderboard report
Image Classification ImageNet ResNet-50 (LIP Bottleneck-256) Number of params 25.8M #850 of 1060 Archive leaderboard report
Image Classification ImageNet ResNet-50 (LIP Bottleneck-256) Top 1 Accuracy 78.15% #850 of 1060 Archive leaderboard report
Image Classification ImageNet LIP-DenseNet-BC-121 Number of params 8.7M #907 of 1060 Archive leaderboard report
Image Classification ImageNet LIP-DenseNet-BC-121 Top 1 Accuracy 76.64% #907 of 1060 Archive leaderboard report
Object Detection COCO minival Faster R-CNN (LIP-ResNet-101) AP50 63.6 #161 of 220 Archive leaderboard report
Object Detection COCO minival Faster R-CNN (LIP-ResNet-101) AP75 45.6 #161 of 220 Archive leaderboard report
Object Detection COCO minival Faster R-CNN (LIP-ResNet-101) APM 45.8 #161 of 220 Archive leaderboard report
Object Detection COCO minival Faster R-CNN (LIP-ResNet-101) APS 25.2 #161 of 220 Archive leaderboard report
Object Detection COCO minival Faster R-CNN (LIP-ResNet-101) box AP 41.7 #161 of 220 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) AP50 65.7 #151 of 225 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) AP75 48.1 #151 of 225 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) APL 56.3 #151 of 225 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) APM 46.7 #151 of 225 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) APS 25.4 #151 of 225 Archive leaderboard report
Object Detection COCO test-dev Faster R-CNN (LIP-ResNet-101-MD w FPN) box mAP 43.9 #151 of 225 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Local Importance-based Pooling

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConcatenated Skip ConnectionConvolutionDense BlockDense ConnectionsDropoutFCNFPNFaster R-CNNGlobal Average PoolingInstance NormalizationKaiming InitializationLocal Importance-based PoolingMax PoolingRPNReLUResidual BlockResidual ConnectionRoIPoolSGD with MomentumSoftmaxWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections