Methods › Computer Vision › Image Models › DeiT

Data-efficient Image Transformer

DeiT

93 papers tagged archive 2025-07-28

archive 2025-07-28 Description, source and code snippet are the archive's method entry.

A Data-Efficient Image Transformer is a type of Vision Transformer for image classification tasks. The model is trained using a teacher-student strategy specific to transformers. It relies on a distillation token ensuring that the student learns from the teacher through attention.

Source: Training data-efficient image transformers &...See Code · facebookresearch/deit

Papers archive 2025-07-28

30 shown of 93, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.

Tasks archive 2025-07-28

20 shown of 78 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.

TaskPapers
Image Classification25
image-classification16
Object Detection11
Quantization10
object-detection10
Semantic Segmentation8
Inductive Bias6
Position5
Self-Supervised Learning5
Efficient ViTs4
Fine-Grained Image Classification4
Knowledge Distillation4
Data Augmentation3
Document Image Classification3
Document Layout Analysis3
Mamba3
Neural Architecture Search3
Representation Learning3
All2
AutoML2

Usage over time archive 2025-07-28

Papers per year tagged with DeiT: 2020 to 2025, peak 27 27 0 2020: 1 paper 2020 2021: 27 papers 2021 2022: 23 papers 2022 2023: 20 papers 2023 2024: 16 papers 2024 2025: 6 papers 2025
Papers per year the archive tags with this method, by the paper's archive date (93 dated). Bars are counts, not a trend claim.

Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).

Categories archive 2025-07-28

Image Models

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections