Datasets › MM-Vet

MM-Vet

Introduced by Weihao Yu et al. in MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities4 Aug 2023 archive 2025-07-28

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

Benchmarks archive 2025-07-28

All 2 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 5 newer papers were judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Visual Question Answering · MM-Vet (3 judged, 0 placed), Visual Question Answering (VQA) · MM-Vet (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

First row (archive order)PaperCode
Visual Question Answering MM-Vet gemini-2.0-flash-exp GPT-4 score 81.2±0.4 — — 231 Compare
Visual Question Answering (VQA) MM-Vet Lyra-Pro Acc 71.4 Lyra: An Efficient and Speech-Centric Framework for... dvlab-research/Lyra 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 147 · with a code link: 108 · where Syntology ran a sample: 69 (56 with a run with no instrument failure, 13 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (69 of 147 with a benchmark row: 56 with a run with no instrument failure, 13 where every run was a failure of Syntology's instrument)

Page 1 of 2: papers 1 to 100 of 147 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 339. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling 1 2 29 Jan 2025 not harvested
Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding 1 1 14 Jan 2025 not harvested
Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition 1 4 12 Dec 2024 official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 6 where Syntology's instrument failed) · 5 unverified (4 pointer-only for licence)
ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhance 0 1 9 Dec 2024 not harvested
ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models 1 2 9 Dec 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 8 unverified
TACO: Learning Multi-modal Action Models with Synthetic Chains-of-Thought-and-Action 1 3 7 Dec 2024 not harvested
Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling 1 7 6 Dec 2024 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified
LinVT: Empower Your Image-level Large Language Model to Understand Videos 1 1 6 Dec 2024 official (archive's flag): 7 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 1 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (12 pointer-only for licence)
MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale 1 2 6 Dec 2024 not harvested
FlashSloth: Lightning Multimodal Large Language Models via Embedded Visual Compression 1 2 5 Dec 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (7 pointer-only for licence)
VisionZip: Longer is Better but Not Necessary in Vision Language Models 1 6 5 Dec 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified
A Stitch in Time Saves Nine: Small VLM is a Precise Guidance for Accelerating Large VLMs 1 3 4 Dec 2024 official: harvested, nothing ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (5 pointer-only for licence)
Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context Sparsification 1 2 1 Dec 2024 official (archive's flag): 13 ran · 13 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified
FocusLLaVA: A Coarse-to-Fine Approach for Efficient and Effective Visual Token Compression 0 1 21 Nov 2024 not harvested
Looking Beyond Text: Reducing Language bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidance 0 2 21 Nov 2024 not harvested
JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generation 1 1 12 Nov 2024 not harvested
Aligned Vector Quantization for Edge-Cloud Collabrative Vision-Language Models 0 1 8 Nov 2024 not harvested
γ-MoD: Exploring Mixture-of-Depth Adaptation for Multimodal Large Language Models 0 1 17 Oct 2024 not harvested
H2OVL-Mississippi Vision Language Models Technical Report 0 2 17 Oct 2024 not harvested
Improving Multi-modal Large Language Model through Boosting Vision Capabilities 0 1 17 Oct 2024 not harvested
Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation 1 1 17 Oct 2024 not harvested
Cross-Modal Safety Mechanism Transfer in Large Vision-Language Models 0 1 16 Oct 2024 not harvested
MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding 1 1 15 Oct 2024 not harvested
MMAR: Towards Lossless Multi-Modal Auto-Regressive Probabilistic Modeling 0 2 14 Oct 2024 not harvested
VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment 0 4 12 Oct 2024 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
Baichuan-Omni Technical Report 2 1 11 Oct 2024 not harvested
Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training 0 1 10 Oct 2024 not harvested
Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate 1 2 9 Oct 2024 official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 10 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Gamified crowd-sourcing of high-quality data for visual fine-tuning 0 3 5 Oct 2024 not harvested
MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning 0 6 30 Sep 2024 not harvested
Emu3: Next-Token Prediction is All You Need 2 1 27 Sep 2024 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
Phantom of Latent for Large Language and Vision Models 1 1 23 Sep 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution 8 3 18 Sep 2024 official (archive's flag): 4 ran · 12 ran (of which 1 constructed an object rather than computing a result; 10 with no instrument failure: 4 honoured, 1 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
POINTS: Improving Your Vision-language Model with Affordable Strategies 0 1 7 Sep 2024 not harvested
CogVLM2: Visual Language Models for Image and Video Understanding 3 2 29 Aug 2024 official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified
MaVEn: An Effective Multi-granularity Hybrid Visual Encoding Framework for Multimodal Large Language Model 0 1 22 Aug 2024 not harvested
SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs 0 1 21 Aug 2024 not harvested
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition 1 1 19 Aug 2024 not harvested
Visual Agents as Fast and Slow Thinkers 1 1 16 Aug 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
CROME: Cross-Modal Adapters for Efficient Multimodal LLM 0 1 13 Aug 2024 not harvested
mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models 1 1 9 Aug 2024 not harvested
Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Models 0 1 8 Aug 2024 not harvested
LLaVA-OneVision: Easy Visual Task Transfer 2 3 6 Aug 2024 not harvested
VILA²: VILA Augmented VILA 0 1 24 Jul 2024 not harvested
INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model 1 1 23 Jul 2024 official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity 1 2 22 Jul 2024 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception 1 2 11 Jul 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (4 pointer-only for licence)
Rethinking Visual Prompting for Multimodal Large Language Models with External Knowledge 0 1 5 Jul 2024 not harvested
InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output 1 1 3 Jul 2024 official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
TokenPacker: Efficient Visual Projector for Multimodal LLM 1 2 2 Jul 2024 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Efficient Large Multi-modal Models via Visual Context Compression 1 1 28 Jun 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment 2 2 28 Jun 2024 not harvested
MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning 1 1 25 Jun 2024 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Claude 3.5 Sonnet Model Card Addendum 0 1 24 Jun 2024 not harvested
TroL: Traversal of Layers for Large Language and Vision Models 1 1 18 Jun 2024 official (archive's flag): 23 ran · 23 ran (of which 11 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 11 where Syntology's instrument failed) · 7 unverified (30 pointer-only for licence)
MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs 1 1 17 Jun 2024 official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (6 pointer-only for licence)
Mixture-of-Subspaces in Low-Rank Adaptation 1 2 16 Jun 2024 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (6 pointer-only for licence)
Explore the Limits of Omni-modal Pretraining at Scale 1 1 13 Jun 2024 not harvested
What If We Recaption Billions of Web Images with LLaMA-3? 0 1 12 Jun 2024 not harvested
Towards Semantic Equivalence of Tokenization in Multimodal LLM 0 1 7 Jun 2024 not harvested
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs 0 1 6 Jun 2024 not harvested
RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation 0 1 6 Jun 2024 not harvested
Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models 1 1 3 Jun 2024 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Enhancing Large Vision Language Models with Self-Training on Image Comprehension 1 2 30 May 2024 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning 0 1 28 May 2024 not harvested
ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models 1 1 24 May 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement 2 1 24 May 2024 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models 1 1 24 May 2024 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified
AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability 0 2 23 May 2024 not harvested
Calibrated Self-Rewarding Vision Language Models 1 2 23 May 2024 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models 1 1 23 May 2024 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
LOVA3: Learning to Visual Question Answering, Asking and Assessment 1 1 23 May 2024 official (archive's flag): 7 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 2 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (10 pointer-only for licence)
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models 0 1 22 May 2024 not harvested
Imp: Highly Capable Large Multimodal Models for Mobile Devices 1 3 20 May 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts 1 1 18 May 2024 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (8 pointer-only for licence)
Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model 4 1 15 May 2024 not harvested
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts 1 1 9 May 2024 official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites 1 2 25 Apr 2024 not harvested
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs 1 2 25 Apr 2024 not harvested
Self-Supervised Visual Preference Alignment 1 2 16 Apr 2024 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 1 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (11 pointer-only for licence)
Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models 1 1 11 Apr 2024 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (5 pointer-only for licence)
InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD 2 1 9 Apr 2024 not harvested
OmniFusion Technical Report 0 1 9 Apr 2024 not harvested
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning 1 2 27 Mar 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models 2 3 27 Mar 2024 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models 1 1 20 Mar 2024 not harvested
VL-Mamba: Exploring State Space Models for Multimodal Learning 0 1 20 Mar 2024 not harvested
Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models 1 1 19 Mar 2024 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant 2 2 17 Mar 2024 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training 0 3 14 Mar 2024 not harvested
Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization 0 2 13 Mar 2024 not harvested
MoAI: Mixture of All Intelligence for Large Language and Vision Models 1 1 12 Mar 2024 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
Multi-modal Auto-regressive Modeling via Visual Words 1 1 12 Mar 2024 not harvested
Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models 1 1 10 Mar 2024 not harvested
DeepSeek-VL: Towards Real-World Vision-Language Understanding 1 1 8 Mar 2024 official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context 1 2 8 Mar 2024 not harvested
Feast Your Eyes: Mixture-of-Resolution Adaptation for Multimodal Large Language Models 1 1 5 Mar 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified
InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding 0 1 3 Mar 2024 not harvested
The All-Seeing Project V2: Towards General Relation Comprehension of the Open World 1 1 29 Feb 2024 official (archive's flag): 7 ran · 7 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (8 pointer-only for licence)
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis 0 1 25 Feb 2024 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY-NC 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • MM-Vet

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections