Methods › Computer Vision › Vision Transformers › Vision Transformer
Vision Transformer
Introduced by Alexey Dosovitskiy et al. in An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over patches of the image. An image is split into fixed-size patches, each of them are then linearly embedded, position embeddings are added, and the resulting sequence of vectors is fed to a standard Transformer encoder. In order to perform classification, the standard approach of adding an extra learnable “classification token” to the sequence is used.
In Syntology about another paper, arXiv:2609.24424: repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: listed only). About another paper: this answer is about arXiv:2609.24424, while the archive credits arXiv:2010.11929.
Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.
- Agentic Transformer · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Agentic Transformer') - Waypoint Transformer · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Waypoint Transformer') - Block-State Transformer · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Block-State Transformer') - Bootstrapped Transformer · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Bootstrapped Transformer') - Focused Transformer (FOT) · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Focused Transformer (FOT)') - Elastic Decision Transformer · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Elastic Decision Transformer')
Origin paper of this answer, arXiv:2609.24424 (its page on this site · its page on Syntology): in Syntology's graph layer with no harvested code sample.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 2,144 · with a code link: 1,051 · where Syntology ran a sample: 328 (277 with a run with no instrument failure, 51 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (328 of 2,144 tagged: 277 with a run with no instrument failure, 51 where every run was a failure of Syntology's instrument)
Page 1 of 22: papers 1 to 100 of 2,144, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
DASViT: Differentiable Architecture Search for Vision Transformer 17 Jul 2025 · 0 repositories · arXiv:2507.13079
-
Token Compression Meets Compact Vision Transformers: A Survey and Comparative Evaluation for Edge AI 13 Jul 2025 · 0 repositories · arXiv:2507.09702
-
Comparative Analysis of Vision Transformers and Traditional Deep Learning Approaches for Automated Pneumonia Detection in Chest X-Rays 11 Jul 2025 · 0 repositories · arXiv:2507.10589
-
Feed-Forward SceneDINO for Unsupervised Semantic Scene Completion 8 Jul 2025 · 1 repository · arXiv:2507.06230
-
Tile-Based ViT Inference with Visual-Cluster Priors for Zero-Shot Multi-Species Plant Identification 8 Jul 2025 · 1 repository · arXiv:2507.06093
-
GroundingDINO-US-SAM: Text-Prompted Multi-Organ Segmentation in Ultrasound with LoRA-Tuned Vision-Language Models 30 Jun 2025 · 0 repositories · arXiv:2506.23903
-
Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking 30 Jun 2025 · 1 repository · arXiv:2506.23783
-
Attention to Burstiness: Low-Rank Bilinear Prompt Tuning 28 Jun 2025 · 1 repository · arXiv:2506.22908
-
Boosting Generative Adversarial Transferability with Self-supervised Vision Transformer Features 26 Jun 2025 · 1 repository · arXiv:2506.21046
-
Distributed Cross-Channel Hierarchical Aggregation for Foundation Models 26 Jun 2025 · 0 repositories · arXiv:2506.21411
-
X-SiT: Inherently Interpretable Surface Vision Transformers for Dementia Diagnosis 25 Jun 2025 · 0 repositories · arXiv:2506.20267
-
Vision Transformer-Based Time-Series Image Reconstruction for Cloud-Filling Applications 24 Jun 2025 · 0 repositories · arXiv:2506.19591
-
An Audio-centric Multi-task Learning Framework for Streaming Ads Targeting on Spotify 23 Jun 2025 · 0 repositories · arXiv:2506.18735
-
Deep CNN Face Matchers Inherently Support Revocable Biometric Templates 23 Jun 2025 · 0 repositories · arXiv:2506.18731
-
SSAVSV: Towards Unified Model for Self-Supervised Audio-Visual Speaker Verification 21 Jun 2025 · 0 repositories · arXiv:2506.17694
-
Exoplanet Classification through Vision Transformers with Temporal Image Analysis 19 Jun 2025 · 0 repositories · arXiv:2506.16597
-
DepthSeg: Depth prompting in remote sensing semantic segmentation 17 Jun 2025 · 0 repositories · arXiv:2506.14382
-
How Real is CARLAs Dynamic Vision Sensor? A Study on the Sim-to-Real Gap in Traffic Object Detection 16 Jun 2025 · 0 repositories · arXiv:2506.13722
-
MultiViT2: A Data-augmented Multimodal Neuroimaging Prediction Framework via Latent Diffusion Model 16 Jun 2025 · 0 repositories · arXiv:2506.13667
-
GM-LDM: Latent Diffusion Model for Brain Biomarker Identification through Functional Data-Driven Gray Matter Synthesis 15 Jun 2025 · 0 repositories · arXiv:2506.12719
-
DART: Differentiable Dynamic Adaptive Region Tokenizer for Vision Transformer and Mamba 12 Jun 2025 · 1 repository · arXiv:2506.10390
-
HyBiomass: Global Hyperspectral Imagery Benchmark Dataset for Evaluating Geospatial Foundation Models in Forest Aboveground Biomass Estimation 12 Jun 2025 · 0 repositories · arXiv:2506.11314
-
PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis 12 Jun 2025 · 1 repository · arXiv:2506.10669
-
Rethinking Random Masking in Self Distillation on ViT 12 Jun 2025 · 0 repositories · arXiv:2506.10582
-
Retrieval of Surface Solar Radiation through Implicit Albedo Recovery from Temporal Context 11 Jun 2025 · 1 repository · arXiv:2506.10174
-
Fine-Grained Spatially Varying Material Selection in Images 10 Jun 2025 · 0 repositories · arXiv:2506.09023
-
FloorplanMAE:A self-supervised framework for complete floorplan generation from partial inputs 10 Jun 2025 · 0 repositories · arXiv:2506.08363
-
PatchGuard: Adversarially Robust Anomaly Detection and Localization through Vision Transformers and Pseudo Anomalies 10 Jun 2025 · 2 repositories · arXiv:2506.09237
-
Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers 10 Jun 2025 · 0 repositories · arXiv:2506.08641
-
Textile Analysis for Recycling Automation using Transfer Learning and Zero-Shot Foundation Models 6 Jun 2025 · 0 repositories · arXiv:2506.06569
-
Token Transforming: A Unified and Training-Free Token Compression Framework for Vision Transformer Acceleration 6 Jun 2025 · 0 repositories · arXiv:2506.05709
-
Interpretable Multimodal Framework for Human-Centered Street Assessment: Integrating Visual-Language Models for Perceptual Urban Diagnostics 5 Jun 2025 · 0 repositories · arXiv:2506.05087
-
Single GPU Task Adaptation of Pathology Foundation Models for Whole Slide Image Analysis 5 Jun 2025 · 0 repositories · arXiv:2506.05184
-
Stable Vision Concept Transformers for Medical Diagnosis 5 Jun 2025 · 0 repositories · arXiv:2506.05286
-
Attacking Attention of Foundation Models Disrupts Downstream Tasks 3 Jun 2025 · 1 repository · arXiv:2506.05394
-
Multi-modal brain MRI synthesis based on SwinUNETR 3 Jun 2025 · 0 repositories · arXiv:2506.02467
-
Talk2SAM: Text-Guided Semantic Enhancement for Complex-Shaped Object Segmentation 3 Jun 2025 · 0 repositories · arXiv:2506.05396
-
Leveraging AM and FM Rhythm Spectrograms for Dementia Classification and Assessment 1 Jun 2025 · 1 repository · arXiv:2506.00861
-
Interpreting Large Text-to-Image Diffusion Models with Dictionary Learning 30 May 2025 · 1 repository · arXiv:2505.24360
-
Leveraging Intermediate Features of Vision Transformer for Face Anti-Spoofing 30 May 2025 · 0 repositories · arXiv:2505.24402
-
PCIE_Pose Solution for EgoExo4D Pose and Proficiency Estimation Challenge 30 May 2025 · 0 repositories · arXiv:2505.24411
-
DA-VPT: Semantic-Guided Visual Prompt Tuning for Vision Transformers 29 May 2025 · 1 repository · arXiv:2505.23694Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 5 harvested samples)
-
Deep Modeling and Optimization of Medical Image Classification 29 May 2025 · 1 repository · arXiv:2505.23040
-
Differential Gated Self-Attention 29 May 2025 · 0 repositories · arXiv:2505.24054
-
DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Models 29 May 2025 · 0 repositories · arXiv:2505.24025
-
UP-SLAM: Adaptively Structured Gaussian SLAM with Uncertainty Prediction in Dynamic Environments 28 May 2025 · 0 repositories · arXiv:2505.22335
-
Beyond 1D: Vision Transformers and Multichannel Signal Images for PPG-to-ECG Reconstruction 27 May 2025 · 0 repositories · arXiv:2505.21767
-
Privacy-Preserving Chest X-ray Report Generation via Multimodal Federated Learning with ViT and GPT-2 27 May 2025 · 0 repositories · arXiv:2505.21715
-
Aggregated Structural Representation with Large Language Models for Human-Centric Layout Generation 26 May 2025 · 0 repositories · arXiv:2505.19554
-
Electrolyzers-HSI: Close-Range Multi-Scene Hyperspectral Imaging Benchmark Dataset 26 May 2025 · 0 repositories · arXiv:2505.20507
-
Regularized Personalization of Text-to-Image Diffusion Models without Distributional Drift 26 May 2025 · 0 repositories · arXiv:2505.19519
-
The Missing Point in Vision Transformers for Universal Image Segmentation 26 May 2025 · 1 repository · arXiv:2505.19795
-
A Smart Healthcare System for Monkeypox Skin Lesion Detection and Tracking 25 May 2025 · 0 repositories · arXiv:2505.19023
-
CDPDNet: Integrating Text Guidance with Hybrid Vision Encoders for Medical Image Segmentation 25 May 2025 · 1 repository · arXiv:2505.18958
-
Is Attention Required for Transformer Inference? Explore Function-preserving Attention Replacement 24 May 2025 · 0 repositories · arXiv:2505.21535
-
Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations 24 May 2025 · 0 repositories · arXiv:2505.18584
-
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification 23 May 2025 · 0 repositories · arXiv:2505.18315
-
AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer 22 May 2025 · 0 repositories · arXiv:2505.16463
-
Fusion of Foundation and Vision Transformer Model Features for Dermatoscopic Image Classification 22 May 2025 · 0 repositories · arXiv:2505.16338
-
Native Segmentation Vision Transformers 22 May 2025 · 0 repositories · arXiv:2505.16993
-
An Exploratory Approach Towards Investigating and Explaining Vision Transformer and Transfer Learning for Brain Disease Detection 21 May 2025 · 0 repositories · arXiv:2505.16039
-
Domain Adaptive Skin Lesion Classification via Conformal Ensemble of Vision Transformers 21 May 2025 · 0 repositories · arXiv:2505.15997
-
SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification 20 May 2025 · 1 repository · arXiv:2505.14561
-
MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion 19 May 2025 · 1 repository · arXiv:2505.14719
-
Guiding Diffusion with Deep Geometric Moments: Balancing Fidelity and Variation 18 May 2025 · 0 repositories · arXiv:2505.12486
-
Enhancing Mathematics Learning for Hard-of-Hearing Students Through Real-Time Palestinian Sign Language Recognition: A New Dataset 16 May 2025 · 0 repositories · arXiv:2505.17055
-
IMAGE-ALCHEMY: Advancing subject fidelity in personalised text-to-image generation 15 May 2025 · 0 repositories · arXiv:2505.10743
-
MIPHEI-ViT: Multiplex Immunofluorescence Prediction from H&E Images using ViT Foundation Models 15 May 2025 · 1 repository · arXiv:2505.10294
-
Zero-Shot Multi-modal Large Language Model v.s. Supervised Deep Learning: A Comparative Study on CT-Based Intracranial Hemorrhage Subtyping 14 May 2025 · 1 repository · arXiv:2505.09252
-
A Deep Learning-Driven Inhalation Injury Grading Assistant Using Bronchoscopy Images 13 May 2025 · 0 repositories · arXiv:2505.08517
-
CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasets 13 May 2025 · 0 repositories · arXiv:2505.08259
-
TiMo: Spatiotemporal Foundation Model for Satellite Image Time Series 13 May 2025 · 1 repository · arXiv:2505.08723
-
Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts 13 May 2025 · 0 repositories · arXiv:2505.08838
-
Breast Cancer Classification in Deep Ultraviolet Fluorescence Images Using a Patch-Level Vision Transformer Framework 12 May 2025 · 0 repositories · arXiv:2505.07654
-
Hybrid Spiking Vision Transformer for Object Detection with Event Cameras 12 May 2025 · 0 repositories · arXiv:2505.07715
-
LAMM-ViT: AI Face Detection via Layer-Aware Modulation of Region-Guided Attention 12 May 2025 · 0 repositories · arXiv:2505.07734
-
MAIS: Memory-Attention for Interactive Segmentation 12 May 2025 · 0 repositories · arXiv:2505.07511
-
Multi-Plane Vision Transformer for Hemorrhage Classification Using Axial and Sagittal MRI Data 12 May 2025 · 0 repositories · arXiv:2505.07349
-
Sleep Position Classification using Transfer Learning for Bed-based Pressure Sensors 12 May 2025 · 0 repositories · arXiv:2505.08111
-
BridgeIV: Bridging Customized Image and Video Generation through Test-Time Autoregressive Identity Propagation 11 May 2025 · 0 repositories · arXiv:2505.06985
-
Image Classification Using a Diffusion Model as a Pre-Training Model 11 May 2025 · 0 repositories · arXiv:2505.06890
-
NeuRN: Neuro-inspired Domain Generalization for Image Classification 11 May 2025 · 0 repositories · arXiv:2505.06881
-
Let Humanoids Hike! Integrative Skill Development on Complex Trails 9 May 2025 · 0 repositories · arXiv:2505.06218
-
UniVLA: Learning to Act Anywhere with Task-centric Latent Actions 9 May 2025 · 1 repository · arXiv:2505.06111Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise 7 May 2025 · 0 repositories · arXiv:2505.04375
-
DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perception 7 May 2025 · 1 repository · arXiv:2505.04410Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
DOTA: Deformable Optimized Transformer Architecture for End-to-End Text Recognition with Retrieval-Augmented Generation 7 May 2025 · 0 repositories · arXiv:2505.04175
-
ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling 7 May 2025 · 0 repositories · arXiv:2505.04802
-
Pose Estimation for Intra-cardiac Echocardiography Catheter via AI-Based Anatomical Understanding 7 May 2025 · 0 repositories · arXiv:2505.07851
-
Attonsecond Streaking Phase Retrieval Via Deep Learning Methods 6 May 2025 · 0 repositories · arXiv:2505.06275
-
From Word to Sentence: A Large-Scale Multi-Instance Dataset for Open-Set Aerial Detection 6 May 2025 · 0 repositories · arXiv:2505.03334
-
Rethinking Boundary Detection in Deep Learning-Based Medical Image Segmentation 6 May 2025 · 1 repository · arXiv:2505.04652
-
Deep learning of personalized priors from past MRI scans enables fast, quality-enhanced point-of-care MRI with low-cost systems 5 May 2025 · 0 repositories · arXiv:2505.02470
-
Local Herb Identification Using Transfer Learning: A CNN-Powered Mobile Application for Nepalese Flora 4 May 2025 · 0 repositories · arXiv:2505.02147
-
Toward Onboard AI-Enabled Solutions to Space Object Detection for Space Sustainability 3 May 2025 · 0 repositories · arXiv:2505.01650
-
FalconWing: An Open-Source Platform for Ultra-Light Fixed-Wing Aircraft Research 2 May 2025 · 0 repositories · arXiv:2505.01383
-
DARTer: Dynamic Adaptive Representation Tracker for Nighttime UAV Tracking 1 May 2025 · 0 repositories · arXiv:2505.00752
-
Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstruction 1 May 2025 · 0 repositories · arXiv:2505.00615
-
Advance Fake Video Detection via Vision Transformers 29 Apr 2025 · 0 repositories · arXiv:2504.20669
-
A Few-Shot Metric Learning Method with Dual-Channel Attention for Cross-Modal Same-Neuron Identification 23 Apr 2025 · 0 repositories · arXiv:2504.16520
Tasks archive 2025-07-28
20 shown of 839 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections