MME

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 47 papers with code (95 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Semi-supervised Domain Adaptation via Minimax Entropy
  13 Apr 2019 5 repositories listed Syntology ran 5 of 24 samples · 19 unverified · 2 pointer-only (licence)
  Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision.
• MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMs
  22 Nov 2024 4 repositories listed
  As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia.
• MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
  23 Jun 2023 4 repositories listed
  Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image.
• InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition
  26 Sep 2023 3 repositories listed
  We propose InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition.
• VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluation
  20 May 2025 2 repositories listed Syntology ran 5 of 14 samples · 9 unverified
  Large multimodal models (LMMs) have recently emerged as a powerful tool for long video understanding (LVU), prompting the development of standardized LVU benchmarks to evaluate their performance.
• TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videos
  24 Apr 2025 2 repositories listed Syntology ran 7 of 12 samples · 5 unverified
  Remarkably, our experiments demonstrate that DTD achieves an 82.
• SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
  2 Apr 2025 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Motivated by the success of Reinforcement Learning with Verifiable Reward (RLVR) in unlocking LLM reasoning abilities, this work aims to improve MLLMs in video spatial reasoning through the RLVR paradigm.
• Long Context Transfer from Language to Vision
  24 Jun 2024 2 repositories listed Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
  By simply extrapolating the context length of the language backbone, we enable LMMs to comprehend orders of magnitude more visual tokens without any video training.
• Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding
  27 Mar 2024 2 repositories listed Syntology ran 1 of 8 samples · 7 unverified · 1 pointer-only (licence)
  Our method is inspired by our observation that what we call disturbance instructions significantly exacerbate hallucinations in multimodal fusion modules.
• A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise
  19 Dec 2023 2 repositories listed
  They endow Large Language Models (LLMs) with powerful capabilities in visual understanding, enabling them to tackle diverse multi-modal tasks.
• MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
  14 Sep 2023 2 repositories listed Syntology ran 5 of 7 samples · 2 unverified · 7 pointer-only (licence)
  In this paper, we address the limitation above by 1) introducing vision-language Model with Multi-Modal In-Context Learning(MMICL), a new approach to allow the VLM to deal with multi-modal inputs efficiently; 2)…
• Masked Motion Encoding for Self-Supervised Video Representation Learning
  12 Oct 2022 2 repositories listed
  The latest attempts seek to learn a representation model by predicting the appearance contents in the masked regions.
• High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
  8 Jul 2025 1 repository listed
  State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task.
• Flash-VStream: Efficient Real-Time Understanding for Long Video Streams
  30 Jun 2025 1 repository listed Syntology ran 7 of 11 samples · 4 unverified
  Benefiting from the advances in large language models and cross-modal alignment, existing multimodal large language models have achieved prominent performance in image and short video understanding.
• VideoDeepResearch: Long Video Understanding With Agentic Tool Using
  12 Jun 2025 1 repository listed
  Long video understanding (LVU) presents a significant challenge for current multi-modal large language models (MLLMs) due to the task's inherent complexity and context window constraint.
• SiLVR: A Simple Language-based Video Reasoning Framework
  30 May 2025 1 repository listed
  In the second stage, language descriptions are fed into a powerful reasoning LLM to solve complex video-language understanding tasks.
• FRAG: Frame Selection Augmented Generation for Long Video and Long Document Understanding
  24 Apr 2025 1 repository listed
  However, the model size and performance of these long context models are still limited due to the computational cost in both training and inference.
• Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models
  21 Apr 2025 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  We introduce Eagle 2.
• BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understanding
  27 Mar 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  In this paper, we introduce BOLT, a method to BOost Large VLMs without additional Training through a comprehensive study of frame selection strategies.
• Instruction-Aligned Visual Attention for Mitigating Hallucinations in Large Vision-Language Models
  24 Mar 2025 1 repository listed
  Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects.
• QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehension
  11 Mar 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Specifically, (i) QuoTA strategically allocates frame-level importance scores based on query relevance, enabling one-time visual token assignment before cross-modal interactions in decoder layers, (ii) we decouple the…
• Re-Imagining Multimodal Instruction Tuning: A Representation View
  2 Mar 2025 1 repository listed Syntology ran 1 of 4 samples · 3 unverified · 4 pointer-only (licence)
  Multimodal instruction tuning has proven to be an effective strategy for achieving zero-shot generalization by fine-tuning pre-trained Large Multimodal Models (LMMs) with instruction-following data.
• Towards Text-Image Interleaved Retrieval
  18 Feb 2025 1 repository listed Syntology ran 2 of 6 samples · 4 unverified
  In this work, we introduce the text-image interleaved retrieval (TIIR) task, where the query and document are interleaved text-image sequences, and the model is required to understand the semantics from the interleaved…
• Expand VSR Benchmark for VLLM to Expertize in Spatial Rules
  24 Dec 2024 1 repository listed
  We found current VLLMs to exhibit a contradiction of over-sensitivity to language instructions and under-sensitivity to visual positional information.
• Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition
  12 Dec 2024 1 repository listed Syntology ran 3 of 19 samples · 16 unverified
  As Multi-modal Large Language Models (MLLMs) evolve, expanding beyond single-domain capabilities is essential to meet the demands for more versatile and efficient AI.
• Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension
  20 Nov 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Existing large video-language models (LVLMs) struggle to comprehend long videos correctly due to limited context.
• Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language Bootstrapping
  11 Oct 2024 1 repository listed
  Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across multimodal tasks such as visual perception and reasoning, leading to good performance on various multimodal evaluation benchmarks.
• To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models
  9 Oct 2024 1 repository listed
  However, there is still considerable debate on constructing MLLM architectures, particularly regarding the selection of appropriate connectors for perception tasks of varying granularities.
• Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality
  7 Oct 2024 1 repository listed Syntology ran 2 of 5 samples · 3 unverified
  These biases arise from the visual encoder and the Large Language Model (LLM) backbone, affecting the attention mechanism responsible for aligning multimodal inputs.
• TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable Questions
  5 Oct 2024 1 repository listed
  Large Vision-Language Models (LVLMs) have achieved remarkable progress on visual perception and linguistic interpretation.

Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.