Papers › InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

10 Nov 2022CVPR 2023 1arXiv:2211.05778archive 2025-07-28

Wenhai Wang, Jifeng Dai, Zhe Chen, Zhenhang Huang, Zhiqi Li, Xizhou Zhu, Xiaowei Hu, Tong Lu, Lewei Lu, Hongsheng Li, Xiaogang Wang, Yu Qiao

Compared to the great progress of large-scale vision transformers (ViTs) in recent years, large-scale models based on convolutional neural networks (CNNs) are still in an early state. This work presents a new large-scale CNN-based foundation model, termed InternImage, which can obtain the gain from increasing parameters and training data like ViTs. Different from the recent CNNs that focus on large dense kernels, InternImage takes deformable convolution as the core operator, so that our model not only has the large effective receptive field required for downstream tasks such as detection and segmentation, but also has the adaptive spatial aggregation conditioned by input and task information. As a result, the proposed InternImage reduces the strict inductive bias of traditional CNNs and makes it possible to learn stronger and more robust patterns with large-scale parameters from massive data like ViTs. The effectiveness of our model is proven on challenging benchmarks including ImageNet, COCO, and ADE20K. It is worth mentioning that InternImage-H achieved a new record 65.4 mAP on COCO test-dev and 62.9 mIoU on ADE20K, outperforming current leading CNNs and ViTs. The code will be released at https://github.com/OpenGVLab/InternImage.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2211.05778")

Code

Syntology Ran 2 of 4 code samples harvested from 2 repositories linked to this paper; 2 have no recorded run. Of those that ran: 2 ran · our draft was wrong.

By repository: official repository: 2 samples from 1 repository, 0 ran; community (archive-listed): 2 samples from 1 repository, 2 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

opengvlab/internimage officialmentioned in papermentioned on GitHubpytorch report
OpenGVLab/M3I-Pretraining mentioned on GitHub report
chenller/mmseg-extension mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

4 samples harvested; 2 ran; 0 honoured the contract we drafted; 2 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · our draft was wrong
2unverified

Licence: 0 of the 4 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 2 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

main opengvlab/internimage/classification/extract_feature.py official repository unverified MIT (permissive) · 5f9bbcaceee97948 · report
rgetattr opengvlab/internimage/classification/extract_feature.py official repository unverified MIT (permissive) · 44925cf3831bfe79 · report
build_act_layer chenller/mmseg-extension/mmsegext/models/backbones/intern_image.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · f5dee2f80ed7988a · report
build_norm_layer chenller/mmseg-extension/mmsegext/models/backbones/intern_image.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · e7f1a63c2e99c70f · report

Tasks

2D Object DetectionClassificationImage ClassificationInstance SegmentationObject DetectionSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
2D Object Detection BDD100K val InternImage-H mAP 38.8 #1 of 1 Archive leaderboard report
Image Classification ImageNet InternImage-H GFLOPs 1478 #16 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-H Number of params 1080M #16 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-H Top 1 Accuracy 89.6% #16 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-XL GFLOPs 163 #64 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-XL Number of params 335M #64 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-XL Top 1 Accuracy 88% #64 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-L GFLOPs 108 #77 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-L Number of params 223M #77 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-L Top 1 Accuracy 87.7% #77 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-B GFLOPs 16 #281 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-B Number of params 97M #281 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-B Top 1 Accuracy 84.9% #281 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-S GFLOPs 8 #338 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-S Number of params 50M #338 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-S Top 1 Accuracy 84.2% #338 of 1060 Archive leaderboard report
Image Classification ImageNet InternImage-DCNv3-G (M3I Pre-training) Number of params 3000M #1060 of 1060 Archive leaderboard report
Image Classification Places205 InternImage-H Top 1 Accuracy 71.7% #1 of 15 Archive leaderboard report
Image Classification Places365 InternImage-H(CNN) Top 1 Accuracy 61.2% #3 of 7 Archive leaderboard report
Image Classification iNaturalist 2018 InternImage-H Top-1 Accuracy 92.6% #3 of 60 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H AP50 80.1 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H AP75 61.5 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H APL 74.4 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H APM 58.4 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H APS 37.9 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-H mask AP 55.4 #3 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-XL GFLOPs 1782 #32 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-XL Params (M) 387 #32 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-XL mask AP 48.8 #32 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-L GFLOPs 1399 #35 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-L Params (M) 277 #35 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-L box AP 56.1 #35 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-L mask AP 48.5 #35 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-S GFLOPs 340 #52 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-S Params (M) 69 #52 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-S box AP 49.7 #52 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-S mask AP 44.5 #52 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-T GFLOPs 270 #58 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-T Params (M) 49 #58 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-T box AP 49.1 #58 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-T mask AP 43.7 #58 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-B GFLOPs 501 #93 of 93 Archive leaderboard report
Instance Segmentation COCO minival InternImage-B Params (M) 115 #93 of 93 Archive leaderboard report
Instance Segmentation COCO test-dev InternImage-H AP50 80.8 #107 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev InternImage-H AP75 62.2 #107 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev InternImage-H APL 70.3 #107 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev InternImage-H APM 58.9 #107 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev InternImage-H APS 41.0 #107 of 112 Archive leaderboard report
Object Detection COCO minival InternImage-H box AP 65.0 #4 of 220 Archive leaderboard report
Object Detection COCO minival InternImage-XL box AP 64.2 #10 of 220 Archive leaderboard report
Object Detection COCO test-dev InternImage-H (M3I Pre-training) Params (M) 2180 #2 of 225 Archive leaderboard report
Object Detection COCO test-dev InternImage-H (M3I Pre-training) box mAP 65.5 #2 of 225 Archive leaderboard report
Object Detection COCO test-dev InternImage-XL Params (M) 602 #10 of 225 Archive leaderboard report
Object Detection COCO test-dev InternImage-XL box mAP 64.3 #10 of 225 Archive leaderboard report
Object Detection COCO-O InternImage-L (Cascade Mask R-CNN) Average mAP 37.0 #8 of 45 Archive leaderboard report
Object Detection COCO-O InternImage-L (Cascade Mask R-CNN) Effective Robustness 11.72 #8 of 45 Archive leaderboard report
Object Detection CrowdHuman (full body) InternImage-H AP 97.2 #1 of 19 Archive leaderboard report
Object Detection LVIS v1.0 minival InternImage-H box AP 65.8 #5 of 6 Archive leaderboard report
Object Detection LVIS v1.0 val InternImage-H box AP 63.2 #3 of 15 Archive leaderboard report
Object Detection OpenImages-v6 InternImage-H box AP 74.1 #2 of 2 Archive leaderboard report
Object Detection PASCAL VOC 2012 InternImage-H MAP 97.2 #1 of 7 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-H GFLOPs 4635 #3 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-H Params (M) 1310 #3 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-H Validation mIoU 62.9 #3 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-XL GFLOPs 3142 #48 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-XL Params (M) 368 #48 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-XL Validation mIoU 55.3 #48 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-L GFLOPs 2526 #67 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-L Params (M) 256 #67 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-L Validation mIoU 54.1 #67 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-B GFLOPs 1185 #98 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-B Params (M) 128 #98 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-B Validation mIoU 51.3 #98 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-S GFLOPs 1017 #107 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-S Params (M) 80 #107 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-S Validation mIoU 50.9 #107 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-T GFLOPs 944 #150 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-T Params (M) 59 #150 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-T Validation mIoU 48.1 #150 of 235 Archive leaderboard report
Semantic Segmentation ADE20K InternImage-H (M3I Pre-training) Params (M) 1310 #231 of 235 Archive leaderboard report
Semantic Segmentation Cityscapes test InternImage-H Mean IoU (class) 86.1% #3 of 105 Archive leaderboard report
Semantic Segmentation Cityscapes val InternImage-H mIoU 87 #4 of 99 Archive leaderboard report
Semantic Segmentation Cityscapes val InternImage-XL mIoU 86.4 #6 of 99 Archive leaderboard report
Semantic Segmentation PASCAL Context InternImage-H mIoU 70.3 #3 of 66 Archive leaderboard report
Semantic Segmentation Replica InternImage mIoU 38.4 #2 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionDeformable Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections