Browse State-of-the-Art › Image Comprehension
Image Comprehension
25 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 49 · with a code link: 25 · where Syntology ran a sample: 8 (6 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (8 of 49 tagged: 6 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 49 of 49, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
26 Sep 2023 3 repositories listedWe propose InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition.
-
24 May 2024 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)In this paper, we propose SIMA, a framework that enhances visual and language modality alignment through self-improvement, eliminating the needs for external models or data.
-
27 Mar 2024 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)We try to narrow the gap by mining the potential of VLMs for better performance and any-to-any workflow from three aspects, i. e., high-resolution visual tokens, high-quality data, and VLM-guided generation.
-
27 Feb 2025 1 repository listedTo address fine-grained compositional REC, we propose novel methods based on a Specialist-MLLM collaboration framework, leveraging the complementary strengths of them: Specialist Models handle simpler tasks efficiently…
-
1 Jan 2025 1 repository listedMultimodal large language models (MLLMs) demonstrate strong capabilities in multimodal understanding, reasoning, and interaction but still face the fundamental limitation of hallucinations, where they generate erroneous…
-
7 Dec 2024 1 repository listedTo enhance the model's ability to capture visual information at different levels without increasing model size, we design a novel architecture called Granularity-oriented Mixture of Experts to constraint the model to…
-
5 Dec 2024 1 repository listedWe posit that if a video diffusion model can effectively de-noise video clips by taking the features of a video tokenizer as the condition, then the tokenizer has successfully captured robust spatial and temporal…
-
21 Nov 2024 1 repository listedFurthermore, we introduce MMGenBench-Test, a comprehensive benchmark developed to evaluate LMMs across 13 distinct image patterns, and MMGenBench-Domain, targeting the performance evaluation of LMMs within the…
-
19 Nov 2024 1 repository listedAs an essential visual attribute, image complexity affects human image comprehension and directly influences the performance of computer vision tasks.
-
13 Nov 2024 1 repository listedRecent multimodal retrieval methods have endowed text-based retrievers with multimodal capabilities by utilizing pre-training strategies for visual-text alignment.
-
6 Nov 2024 1 repository listedIn this paper, we introduce StreamingBench, the first comprehensive benchmark designed to evaluate the streaming video understanding capabilities of MLLMs.
-
16 Oct 2024 1 repository listedBased on this, we introduce the Flow Text with Image Insertion Benchmark (FTII-Bench), which includes 318 high-quality Chinese image-text news articles and 307 high-quality English image-text news articles, covering 10…
-
23 Sep 2024 1 repository listed Syntology official (archive's flag): 2 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)Referring Expression Comprehension (REC) is a crucial cross-modal task that objectively evaluates the capabilities of language understanding, image comprehension, and language-to-image grounding.
-
5 Aug 2024 1 repository listedTo fill this gap, we introduce the Multimodal Multi-image Understanding (MMIU) benchmark, a comprehensive evaluation suite designed to assess LVLMs across a wide range of multi-image tasks.
-
31 Jul 2024 1 repository listed Syntology 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 1 pointer-only (licence)However, the scale disparity between vision encoder and language model may led to LLMs assuming a predominant role in multi-modal comprehension.
-
3 Jul 2024 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)This long-context capability allows IXC-2.
-
20 Jun 2024 1 repository listedWe first construct a Vision Question Answering (VQA) dataset of 63.
-
30 May 2024 1 repository listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)To further self-improve reasoning on the extracted visual information, we let the model reuse a small portion of existing instruction-tuning data and append its self-generated image descriptions to the prompts.
-
7 Apr 2024 1 repository listedThis highlights the challenging nature of our benchmark for existing models and the significant gap between the multimodal reasoning capabilities of current models and humans.
-
30 Jan 2024 1 repository listedMulti-modal large language models (MLLMs) have demonstrated remarkable success in vision and visual-language tasks within the natural image domain.
-
CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan 2024 1 repository listedWhen exploring the development of Artificial General Intelligence (AGI), a critical task for these models involves interpreting and processing information from multiple image inputs.
-
3 Aug 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)To this end, we propose to extract features corresponding to regional objects as soft prompts for LLM, which provides a straightforward and scalable approach and eliminates the need for LLM fine-tuning.
-
3 Jul 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)Open-vocabulary image segmentation aims to partition an image into semantic regions according to arbitrary text descriptions.
-
3 Jul 2023 1 repository listedOn our dataset, we have devised four benchmarks to assess the performance of generated image comprehension in relation to both content and style interpretation.
-
12 May 2023 1 repository listedHowever, a grand challenge of exploiting LLMs for multimodal learning is the size of pre-trained LLMs which are always with billions of parameters.
-
CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs30 May 2025 0 repositories listedVision-Language Models (VLMs) have demonstrated remarkable progress in multimodal understanding, yet their capabilities for scientific reasoning remains inadequately assessed.
-
RGB-Th-Bench: A Dense benchmark for Visual-Thermal Understanding of Vision Language Models25 Mar 2025 0 repositories listedWe introduce RGB-Th-Bench, the first benchmark designed to evaluate the ability of Vision-Language Models (VLMs) to comprehend RGB-Thermal image pairs.
-
RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Driving18 Mar 2025 0 repositories listedAccurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems.
-
CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentation7 Mar 2025 0 repositories listedWhile previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained when extended to more complex…
-
SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models18 Feb 2025 0 repositories listedThe increasing application of multi-modal large language models (MLLMs) across various sectors have spotlighted the essence of their output reliability and accuracy, particularly their ability to produce content…
-
Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models10 Jan 2025 0 repositories listed
-
EasyRef: Omni-Generalized Group Image Reference for Diffusion Models via Multimodal LLM12 Dec 2024 0 repositories listed
-
Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges4 Dec 2024 0 repositories listed
-
Aquila: A Hierarchically Aligned Visual-Language Model for Enhanced Remote Sensing Image Comprehension9 Nov 2024 0 repositories listed
-
Teach Multimodal LLMs to Comprehend Electrocardiographic Images21 Oct 2024 0 repositories listed
-
FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMs20 Sep 2024 0 repositories listed
-
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web14 Sep 2024 0 repositories listed
-
Alleviating Hallucination in Large Vision-Language Models with Active Retrieval Augmentation1 Aug 2024 0 repositories listed
-
Unveiling Glitches: A Deep Dive into Image Encoding Bugs within CLIP30 Jun 2024 0 repositories listed
-
Multiplane Prior Guided Few-Shot Aerial Scene Rendering7 Jun 2024 0 repositories listed
-
Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models13 Feb 2024 0 repositories listed
-
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA29 Jan 2024 0 repositories listed
-
SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition18 Jan 2024 0 repositories listed
-
Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine16 Jan 2024 0 repositories listed
-
GeoLocator: a location-integrated large multimodal model for inferring geo-privacy21 Nov 2023 0 repositories listed
-
What Large Language Models Bring to Text-rich VQA?13 Nov 2023 0 repositories listed
-
On the Performance of Multimodal Language Models4 Oct 2023 0 repositories listed
-
Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal Tokens15 Sep 2023 0 repositories listed
-
An End-to-End OCR Text Re-organization Sequence Learning for Rich-text Detail Image Comprehension1 Aug 2020 0 repositories listed
Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections