Methods › Computer Vision › Vision and Language Pre-Trained Models › ViLT

Vision-and-Language Transformer

ViLT

6 papers tagged archive 2025-07-28

Introduced by Wonjae Kim et al. in ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision

archive 2025-07-28 Description, source and code snippet are the archive's method entry.

ViLT is a minimal vision-and-language pre-training transformer model where processing of visual inputs is simplified to just the same convolution-free manner that text inputs are processed. The model-specific components of ViLT require less computation than the transformer component for multimodal interactions. ViLTThe model is pre-trained on the following objectives: image text matching, masked language modeling, and word patch alignment.

Paper Source

Papers archive 2025-07-28

6 shown of 6, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.

Seeing More with Less: Human-like Representations in Vision Models
1 Jan 2025 · 0 repositories
Visual Robustness Benchmark for Visual Question Answering (VQA)
3 Jul 2024 · 1 repository · arXiv:2407.03386
Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis
21 Sep 2023 · 1 repository
VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations
1 Jul 2022 · 1 repository · arXiv:2207.00221
Visual Spatial Reasoning
30 Apr 2022 · 4 repositories · arXiv:2205.00363

Syntology ran 5 of 10 samples · 5 unverified
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
5 Feb 2021 · 6 repositories · arXiv:2102.03334

Syntology ran 1 of 4 samples · 3 unverified · 1 pointer-only (licence)

Tasks archive 2025-07-28

17 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.

Task	Papers
Visual Question Answering (VQA)	3
Visual Reasoning	3
Cross-Modal Retrieval	2
Image Retrieval	2
Zero-Shot Cross-Modal Retrieval	2
object-detection	2
Image Captioning	1
Multimodal Intent Recognition	1
Natural Language Understanding	1
Object Detection	1
Question Answering	1
Spatial Reasoning	1
Text Retrieval	1
Visual Entailment	1
Visual Question Answering	1
Zero-Shot Visual Question Answring	1
multimodal interaction	1

Usage over time archive 2025-07-28

Papers per year the archive tags with this method, by the paper's archive date (6 dated). Bars are counts, not a trend claim.

Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).

Categories archive 2025-07-28

Vision and Language Pre-Trained Models

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections