{"url":"/method/ghost-bottleneck","slug":"ghost-bottleneck","name":"Ghost Bottleneck","full_name":"Ghost Bottleneck","full_name_withheld":false,"description_markdown":"A **Ghost BottleNeck** is a skip connection block, similar to the basic [residual block](https://paperswithcode.com/method/residual-block) in [ResNet](https://paperswithcode.com/method/resnet) in which several convolutional layers and shortcuts are integrated, but stacks [Ghost Modules](https://paperswithcode.com/method/ghost-module) instead (two stacked Ghost modules). It was proposed as part of the [GhostNet](https://paperswithcode.com/method/ghostnet) CNN architecture.\r\n\r\nThe first Ghost module acts as an expansion layer increasing the number of channels. The ratio between the number of the output channels and that of the input is referred to as the *expansion ratio*. The second Ghost module reduces the number of channels to match the shortcut path. Then the shortcut is connected between the inputs and the outputs of these two Ghost modules. The [batch normalization](https://paperswithcode.com/method/batch-normalization) (BN) and [ReLU](https://paperswithcode.com/method/relu) nonlinearity are applied after each layer, except that ReLU is not used after the second Ghost module as suggested by [MobileNetV2](https://paperswithcode.com/method/mobilenetv2). The Ghost bottleneck described above is for stride=1. As for the case where stride=2, the shortcut path is implemented by a downsampling layer and a [depthwise convolution](https://paperswithcode.com/method/depthwise-convolution) with stride=2 is inserted between the two Ghost modules. In practice, the primary [convolution](https://paperswithcode.com/method/convolution) in Ghost module here is [pointwise convolution](https://paperswithcode.com/method/pointwise-convolution) for its efficiency.","description_state":"present","introduced_year":null,"introduced_by":{"title":"GhostNet: More Features from Cheap Operations","paper":"/paper/ghostnet-more-features-from-cheap-operations","first_author":"Kai Han","n_authors":6,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/ghostnet-more-features-from-cheap-operations"},"source":{"url":"https://arxiv.org/abs/1911.11907v2","title":"GhostNet: More Features from Cheap Operations","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/iamhankai/ghostnet.pytorch/blob/a74f64e74014cab190b4c56607c78abc540b0e5d/ghost_net.py#L81","code_snippet_url_on_a_code_host":true,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Image Model Blocks","url":"/methods/category/image-model-blocks","pwc_aliases":[]},{"area":"General","area_id":"general","collection":"Skip Connection Blocks","url":"/methods/category/skip-connection-blocks","pwc_aliases":[]}],"n_papers_tagged":24,"archive_num_papers":24,"papers_newest_first":[{"paper":"/paper/cross-video-identity-correlating-for-person","title":"Cross-video Identity Correlating for Person Re-identification Pre-training","date":"2024-09-27","arxiv_id":"2409.18569","n_code_links":1,"syntology":{"ran":0,"of":1,"unverified":1,"pointer_only":0}},{"paper":"/paper/a-lightweight-insulator-defect-detection","title":"A Lightweight Insulator Defect Detection Model Based on Drone Images","date":"2024-08-26","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/idd-yolov5-a-lightweight-insulator-defect","title":"IDD-YOLOv5: A Lightweight Insulator Defect Real-time Detection Algorithm","date":"2024-08-19","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/liteyolo-id-a-lightweight-object-detection","title":"LiteYOLO-ID: A Lightweight Object Detection Network for Insulator Defect Detection","date":"2024-06-24","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"title":"Multimodal Emotion Recognition based on Facial Expressions, Speech, and EEG","date":"2024-06-11","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"title":"Ghost-Stereo: GhostNet-based Cost Volume Enhancement and Aggregation for Stereo Matching Networks","date":"2024-05-23","arxiv_id":"2405.14520","n_code_links":0,"syntology":null},{"paper":null,"title":"Short-Term Memory Convolutions","date":"2023-02-08","arxiv_id":"2302.04331","n_code_links":0,"syntology":null},{"paper":"/paper/ghostnetv2-enhance-cheap-operation-with-long","title":"GhostNetV2: Enhance Cheap Operation with Long-Range Attention","date":"2022-11-23","arxiv_id":"2211.12905","n_code_links":12,"syntology":{"ran":8,"of":10,"unverified":2,"pointer_only":10}},{"paper":"/paper/repghost-a-hardware-efficient-ghost-module","title":"RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization","date":"2022-11-11","arxiv_id":"2211.06088","n_code_links":3,"syntology":{"ran":5,"of":17,"unverified":12,"pointer_only":0}},{"paper":"/paper/network-amplification-with-efficient-macs","title":"Network Amplification With Efficient MACs Allocation","date":"2022-07-01","arxiv_id":null,"n_code_links":2,"syntology":null},{"paper":null,"title":"YOLOv5s-GTB: light-weighted and improved YOLOv5s for bridge crack detection","date":"2022-06-03","arxiv_id":"2206.01498","n_code_links":0,"syntology":null},{"paper":"/paper/mocovit-mobile-convolutional-vision","title":"MoCoViT: Mobile Convolutional Vision Transformer","date":"2022-05-25","arxiv_id":"2205.12635","n_code_links":1,"syntology":null},{"paper":"/paper/triplenet-a-low-computing-power-platform-of","title":"Efficient Convolutional Neural Networks on Raspberry Pi for Image Classification","date":"2022-04-02","arxiv_id":"2204.00943","n_code_links":1,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":0}},{"paper":"/paper/threshnet-an-efficient-densenet-using","title":"ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connections","date":"2022-01-09","arxiv_id":"2201.03013","n_code_links":1,"syntology":null},{"paper":"/paper/ghostshiftaddnet-more-features-from-energy","title":"GhostShiftAddNet: More Features from Energy-Efficient Operations","date":"2021-09-20","arxiv_id":"2109.09495","n_code_links":3,"syntology":null},{"paper":"/paper/greedy-network-enlarging","title":"Greedy Network Enlarging","date":"2021-07-31","arxiv_id":"2108.00177","n_code_links":1,"syntology":null},{"paper":null,"title":"AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition","date":"2021-02-10","arxiv_id":"2102.05775","n_code_links":0,"syntology":null},{"paper":"/paper/tokens-to-token-vit-training-vision","title":"Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet","date":"2021-01-28","arxiv_id":"2101.11986","n_code_links":13,"syntology":{"ran":21,"of":26,"unverified":5,"pointer_only":8}},{"paper":"/paper/ghostsr-learning-ghost-features-for-efficient","title":"GhostSR: Learning Ghost Features for Efficient Image Super-Resolution","date":"2021-01-21","arxiv_id":"2101.08525","n_code_links":4,"syntology":null},{"paper":null,"title":"A Multi-task Joint Framework for Real-time Person Search","date":"2020-12-11","arxiv_id":"2012.06418","n_code_links":0,"syntology":null},{"paper":null,"title":"Real-time Semantic Segmentation with Context Aggregation Network","date":"2020-11-02","arxiv_id":"2011.00993","n_code_links":0,"syntology":null},{"paper":"/paper/model-rubik-s-cube-twisting-resolution-depth","title":"Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets","date":"2020-10-28","arxiv_id":"2010.14819","n_code_links":9,"syntology":{"ran":0,"of":1,"unverified":1,"pointer_only":1}},{"paper":"/paper/hs-resnet-hierarchical-split-block-on","title":"HS-ResNet: Hierarchical-Split Block on Convolutional Neural Network","date":"2020-10-15","arxiv_id":"2010.07621","n_code_links":2,"syntology":null},{"paper":"/paper/ghostnet-more-features-from-cheap-operations","title":"GhostNet: More Features from Cheap Operations","date":"2019-11-27","arxiv_id":"1911.11907","n_code_links":33,"syntology":{"ran":6,"of":23,"unverified":17,"pointer_only":4}}],"papers_shown":24,"tasks":[{"task":"/task/image-classification","name":"Image Classification","papers":8},{"task":"/task/object-detection","name":"Object Detection","papers":5},{"task":"/task/image-classification","name":"image-classification","papers":5},{"task":"/task/defect-detection","name":"Defect Detection","papers":3},{"task":"/task/insulator-defect-detection","name":"Insulator Defect Detection","papers":3},{"task":"/task/object-detection-1","name":"object-detection","papers":3},{"task":null,"name":"GPU","papers":2},{"task":"/task/model-compression","name":"Model Compression","papers":2},{"task":"/task/segmentation","name":"Segmentation","papers":2},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":2},{"task":"/task/small-object-detection","name":"Small Object Detection","papers":2},{"task":"/task/acoustic-scene-classification","name":"Acoustic Scene Classification","papers":1},{"task":"/task/action-recognition-in-videos","name":"Action Recognition","papers":1},{"task":null,"name":"CPU","papers":1},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":1},{"task":"/task/denoising","name":"Denoising","papers":1},{"task":"/task/depth-estimation","name":"Depth Estimation","papers":1},{"task":"/task/eeg-1","name":"EEG","papers":1},{"task":"/task/emotion-recognition","name":"Emotion Recognition","papers":1},{"task":"/task/human-detection","name":"Human Detection","papers":1}],"tasks_shown":20,"n_tasks":40,"usage_by_year":[{"year":"2019","papers":1},{"year":"2020","papers":4},{"year":"2021","papers":5},{"year":"2022","papers":7},{"year":"2023","papers":1},{"year":"2024","papers":6}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/ghost-bottleneck"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}