Papers › Deformable DETR: Deformable Transformers for End-to-End Object Detection

Deformable DETR: Deformable Transformers for End-to-End Object Detection

8 Oct 2020ICLR 2021 1arXiv:2010.04159archive 2025-07-28

Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, Jifeng Dai

DETR has been recently proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance. However, it suffers from slow convergence and limited feature spatial resolution, due to the limitation of Transformer attention modules in processing image feature maps. To mitigate these issues, we proposed Deformable DETR, whose attention modules only attend to a small set of key sampling points around a reference. Deformable DETR can achieve better performance than DETR (especially on small objects) with 10 times less training epochs. Extensive experiments on the COCO benchmark demonstrate the effectiveness of our approach. Code is released at https://github.com/fundamentalvision/Deformable-DETR.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2010.04159")

Code

Syntology Ran 29 of 55 code samples harvested from 13 repositories linked to this paper; 26 have no recorded run. Of those that ran: 1 ran · honoured contract; 3 ran · violated contract; 10 ran · our draft was wrong; 1 ran · fixture could not drive it; 14 ran with no contract checked.

By repository: community (archive-listed): 55 samples from 13 repositories, 29 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

20 repositories listed; official and paper-mentioned ones first.

fundamentalvision/Deformable-DETR officialmentioned in papermentioned on GitHubpytorch report
Cedric-Perauer/Deformable_Detr_PIL mentioned on GitHubpytorchApache-2.0 report
IDEA-Research/detrex mentioned on GitHubpytorch report
LONGXUANX/CDFormer_code mentioned on GitHubpytorch report
Li-ai-cell/Interpretation_DETR mentioned on GitHubpytorch report
Visual-Behavior/aloception mentioned on GitHubpytorch report
YC-Lai/Sequential-DDETR mentioned on GitHubpytorch report
dianzl/sodformer mentioned on GitHubpytorch report
duongnv0499/Explain-Deformable-DETR mentioned on GitHubpytorch report
fangyi-chen/sqr mentioned on GitHubpytorchMIT report
gokulkarthik/deformable-detr mentioned on GitHubpytorch report
hanouticelina/deformable-DETR mentioned on GitHubpytorch report
haoy945/demf mentioned on GitHubpytorchMIT report
roboflow/rf-detr mentioned on GitHubpytorch report
ver0z/Deformable-DETR- mentioned on GitHubpytorch report
zhechen/deformable-detr-rego mentioned on GitHubpytorchApache-2.0 report
lyqcom/detr mindsporeApache-2.0 report
pwc-1/Paper-8 mindspore report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

55 samples harvested; 29 ran; 1 honoured the contract we drafted; 26 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

1ran · honoured contract
3ran · violated contract
10ran · our draft was wrong
1ran · fixture could not drive it
14ran
26unverified

Licence: 21 of the 55 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 13 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

DeformableDETR dianzl/sodformer/models/deformable_detr.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · eff6751dedaae05e · report
DeformableDETR duongnv0499/Explain-Deformable-DETR/models/deformable_detr.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 50c3542b65114a72 · report
DeformableDETR hanouticelina/deformable-DETR/models/deformable_detr.py community (archive-listed) ran MIT (permissive) · edf20b8faa459a2e · report
DeformableTransformerEncoder LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) ran MIT (permissive) · 963474a60c239350 · report
DeformableTransformerEncoder Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) ran fingerprinted licence not identified · pointer only · 7e36b0b69432a072 · report
InputProj YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) ran Apache-2.0 (permissive) · f5d48d6ab75ae394 · report
MHAttentionMap YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) ran Apache-2.0 (permissive) · e622cf29b035c908 · report
MLP duongnv0499/Explain-Deformable-DETR/models/deformable_detr.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 79f40d31f6868f07 · report
MLP hanouticelina/deformable-DETR/models/deformable_detr.py community (archive-listed) ran MIT (permissive) · e4210f43cf8be779 · report
NestedTensor duongnv0499/Explain-Deformable-DETR/models/deformable_detr.py community (archive-listed) ran · metamorphic tier: deterministic Apache-2.0 (permissive) · a0958f4fe260b7bf · report
ScaledDotProductAttention LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) ran MIT (permissive) · a290e690b43e24ae · report
SingleHeadSiameseAttention LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) ran MIT (permissive) · 2f7e49dbedcfed43 · report
_bilinear_grid_sample roboflow/rf-detr/src/rfdetr/models/ops/modules/ms_deform_attn.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · f30b488cc19991a3 · report
_get_activation_fn LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) ran · our draft was wrong MIT (permissive) · c050b2542997c417 · report
_is_power_of_2 roboflow/rf-detr/src/rfdetr/models/ops/modules/ms_deform_attn.py community (archive-listed) ran · violated contract fingerprinted Apache-2.0 (permissive) · f5dd789303b115e9 · report
bilinear_grid_sample Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) ran · fixture could not drive it fingerprinted licence not identified · pointer only · bf60b14249f09548 · report
convert_to_xywh Cedric-Perauer/Deformable_Detr_PIL/datasets/coco_eval.py community (archive-listed) ran · honoured contract fingerprinted Apache-2.0 recorded; this copy not marked cleared · pointer only · f31a58bf6457ced5 · report
dice_loss Cedric-Perauer/Deformable_Detr_PIL/models/segmentation.py community (archive-listed) ran · violated contract fingerprinted Apache-2.0 recorded; this copy not marked cleared · pointer only · ac8fe530cdad4d8c · report
evaluate Cedric-Perauer/Deformable_Detr_PIL/datasets/coco_eval.py community (archive-listed) ran · our draft was wrong Apache-2.0 recorded; this copy not marked cleared · pointer only · fe0ddcc2d420c9a0 · report
inverse_sigmoid LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · 806f660f9474c72d · report
inverse_sigmoid Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) ran · our draft was wrong fingerprinted licence not identified · pointer only · a57888d65b00fb2b · report
match_name_keywords Cedric-Perauer/Deformable_Detr_PIL/models/deformable_detr.py community (archive-listed) ran · violated contract Apache-2.0 recorded; this copy not marked cleared · pointer only · c15434906f804d7f · report
ms_deform_attn_core_pytorch roboflow/rf-detr/src/rfdetr/models/ops/modules/ms_deform_attn.py community (archive-listed) ran Apache-2.0 (permissive) · 45e605841eb2a56a · report
ms_deform_attn_core_pytorch Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) ran licence not identified · pointer only · 3666672419ef2bd1 · report
nested_tensor_from_tensor_list dianzl/sodformer/models/deformable_detr.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · a51cb66e9b8cd2fd · report
nested_tensor_from_tensor_list duongnv0499/Explain-Deformable-DETR/models/deformable_detr.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · 9691821ac0f2a520 · report
nested_tensor_from_tensor_list YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · ded2ab6086dcbd94 · report
nested_tensor_from_tensor_list zhechen/deformable-detr-rego/models/deformable_detr.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · fe880b26b1a8908a · report
sigmoid_focal_loss Cedric-Perauer/Deformable_Detr_PIL/models/segmentation.py community (archive-listed) ran · our draft was wrong fingerprinted Apache-2.0 recorded; this copy not marked cleared · pointer only · 5c0711aada67957e · report
DeformableDETR YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · a348ef43d0f2a685 · report
DeformableDETR zhechen/deformable-detr-rego/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · 06c84cdd941f9808 · report
DeformableDETR gokulkarthik/deformable-detr/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · 182337c7b8edfc5d · report
DeformableDETR ver0z/Deformable-DETR-/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · 52318efcaf4667da · report
DeformableTransformer LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) unverified MIT (permissive) · 90478de15357b6af · report
DeformableTransformer Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 6bc8b39c78bd319a · report
DeformableTransformerDecoder Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 84635e8f04ac5919 · report
DeformableTransformerDecoderLayer Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 743a6a5cf7951bcc · report
DeformableTransformerEncoderLayer LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) unverified MIT (permissive) · 7fe17a967eb4b659 · report
DeformableTransformerEncoderLayer Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 9137d13f22829ae8 · report
MSDeformAttn LONGXUANX/CDFormer_code/models/deformable_transformer.py community (archive-listed) unverified MIT (permissive) · 128bb63311a349d1 · report
MSDeformAttn roboflow/rf-detr/src/rfdetr/models/ops/modules/ms_deform_attn.py community (archive-listed) unverified Apache-2.0 (permissive) · 764de19ef8f2c6e8 · report
MSDeformAttn Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 878cb59d722b1377 · report
MSDeformAttnFunction Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · d01d807bb6de8266 · report
MaskHeadSmallConv YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · 734f9e92ac03443d · report
NestedTensor zhechen/deformable-detr-rego/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · 6e981ab142d64bc6 · report
_expand YC-Lai/Sequential-DDETR/models/deformable_detr.py community (archive-listed) unverified Apache-2.0 (permissive) · a104be81bc8116a7 · report
box_area lyqcom/detr/src/DETR/util.py community (archive-listed) unverified Apache-2.0 (permissive) · fcdbd1b86b7ff699 · report
box_cxcywh_to_xyxy lyqcom/detr/src/DETR/matcher_np.py community (archive-listed) unverified Apache-2.0 (permissive) · 074307e51146fa09 · report
box_xyxy_to_cxcywh lyqcom/detr/src/DETR/matcher_np.py community (archive-listed) unverified Apache-2.0 (permissive) · dbb0d0f90ff599c4 · report
load_MultiScaleDeformableAttention Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · 95940a739db21b62 · report
load_ops Visual-Behavior/aloception/alonet/deformable_detr/deformable_transformer.py community (archive-listed) unverified licence not identified · pointer only · f907a86f3f649ae2 · report
measure_average_inference_time Cedric-Perauer/Deformable_Detr_PIL/benchmark.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 3e5d34f155e97585 · report
sample_valid_seeds haoy945/demf/demf/modeling/detectors/imvotenet_deform.py community (archive-listed) unverified MIT (permissive) · e79c30fd84dddd35 · report
softmax lyqcom/detr/src/DETR/matcher_np.py community (archive-listed) unverified Apache-2.0 (permissive) · 4c36dfd151b487bb · report
to_cuda Cedric-Perauer/Deformable_Detr_PIL/datasets/data_prefetcher.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 6b447c14f1b53ea9 · report

Tasks

2D Object DetectionObject DetectionReal-Time Object Detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
2D Object Detection SARDet-100K Deformable DETR box mAP 50.0 #7 of 13 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) AP50 71.9 #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) AP75 58.1 #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) APL 65.6 #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) APM 54.4 #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) APS 34.4 #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) Hardware Burden 17G #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) Operations per network pass 17.3G #71 of 225 Archive leaderboard report
Object Detection COCO test-dev Deformable DETR (ResNeXt-101+DCN) box mAP 52.3 #71 of 225 Archive leaderboard report
Object Detection COCO-O Deformable-DETR (ResNet-50) Average mAP 18.5 #33 of 45 Archive leaderboard report
Object Detection COCO-O Deformable-DETR (ResNet-50) Effective Robustness -1.49 #33 of 45 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Deformable Attention Module, Deformable DETR

Absolute Position EncodingsAdamAttentionBPEConvolutionDeformable Attention ModuleDeformable DETRDense ConnectionsDetrDropoutFeedforward NetworkLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections