Browse State-of-the-Art › Chart Question Answering
Chart Question Answering
25 papers with code · 3 benchmarks · 9 datasets archive 2025-07-28
Question Answering task on charts images
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 7 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): ChartQA (7 judged, 0 placed), PlotQA (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| ChartQA (27 rows) | ChartPaLI-5B + PaLM 2-S | Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs | — | — | Compare |
| PlotQA (6 rows) | MatCha4096 + LaMenDa | Synthesize Step-by-Step: Tools Templates and LLMs as Data... | — | — | Compare |
| RealCQA (5 rows) | crct - baseline | ChartQA: A Benchmark for Question Answering about Charts with... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
9 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 50 · with a code link: 25 · where Syntology ran a sample: 7 (6 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (7 of 50 tagged: 6 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 50 of 50, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
7 Oct 2022 4 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)Visually-situated language is ubiquitous -- sources range from textbooks with diagrams to web pages with images and tables, to mobile apps with buttons and forms.
-
20 Sep 2023 3 repositories listedSpecifically, StructChart first reformulates the chart data from the tubular form (linearized CSV) to STR, which can friendlily reduce the task gap between chart perception and reasoning.
-
7 Feb 2024 2 repositories listedAt the heart of this mixture is a novel screen annotation task in which the model has to identify the type and location of UI elements.
-
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug 2023 2 repositories listed Syntology official: harvested for another paper · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images.
-
29 May 2023 2 repositories listed Syntology 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 4 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 2 pointer-only (licence)We present the training recipe and results of scaling up PaLI-X, a multilingual vision and language model, both in terms of size of the components and the breadth of its training task mixture.
-
21 May 2025 1 repository listedThe emergence of Multi-modal Large Language Models (MLLMs) presents new opportunities for chart understanding.
-
13 May 2025 1 repository listedWhile using LVLMs as judges to assess the chart comprehension capabilities of other LVLMs could streamline evaluation processes, challenges like proprietary datasets, restricted access to powerful models, and evaluation…
-
7 Apr 2025 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Charts are ubiquitous, as people often use them to analyze data, answer questions, and discover critical insights.
-
29 Mar 2025 1 repository listedTo bridge this gap, we introduce RefChartQA, a novel benchmark that integrates Chart Question Answering (ChartQA) with visual grounding, enabling models to refer elements at multiple granularities within chart images.
-
23 Dec 2024 1 repository listedOur SBSFigures demonstrate a strong pre-training effect, making it possible to achieve efficient training with a limited amount of real-world chart data starting from our pre-trained weights.
-
3 Sep 2024 1 repository listedCharts are widely used for data visualization across various fields, including education, research, and business.
-
9 Aug 2024 1 repository listedAutomatic Chart Question Answering (ChartQA) is challenging due to the complex distribution of chart elements with patterns of the underlying data not explicitly displayed in charts.
-
29 Jul 2024 1 repository listedTo fill the gap, we propose a visualization-referenced instruction tuning approach to guide the training dataset enhancement and model development.
-
22 Feb 2024 1 repository listedRecently, interpreting complex charts with logical reasoning has emerged as challenges due to the development of vision-language models.
-
29 Oct 2023 1 repository listedOur DCQA dataset is expected to foster research on understanding visualizations in documents, especially for scenarios that require complex reasoning for charts in the visually-rich document.
-
13 Oct 2023 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)This paper presents PaLI-3, a smaller, faster, and stronger vision language model (VLM) that compares favorably to similar models that are 10x larger.
-
3 Aug 2023 1 repository listedWe present a comprehensive study of chart visual question-answering(QA) task, to address the challenges faced in comprehending and extracting data from chart visualizations within documents.
-
24 May 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)Charts are very popular for analyzing data, visualizing key insights and answering complex reasoning questions about data.
-
20 Dec 2022 1 repository listedCompared with a SOTA model finetuned on more than >28k data points, DePlot+LLM with just one-shot prompting achieves a 24.
-
19 Dec 2022 1 repository listedVisual language data such as plots, charts, and infographics are ubiquitous in the human world.
-
19 Mar 2022 1 repository listedTo address the unique challenges in our benchmark involving visual and logical reasoning over charts, we present two transformer-based models that combine visual features and the data table of the chart in a unified way…
-
29 Nov 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Our model is particularly well suited for realistic questions with out-of-vocabulary answers that require regression.
-
5 Aug 2019 1 repository listedChart question answering (CQA) is a newly proposed visual question answering (VQA) task where an algorithm must answer questions about data visualizations, e. g. bar charts, pie charts, and line graphs.
-
24 Jan 2018 1 repository listedBar charts are an effective way to convey numeric information, but today's algorithms cannot parse them.
-
19 Oct 2017 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 12 pointer-only (licence)To resolve, such questions often require reference to multiple plot elements and synthesis of information distributed spatially throughout a figure.
-
ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering11 Jun 2025 0 repositories listedRecently, large language models have shown remarkable reasoning capabilities through long-chain reasoning before responding.
-
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering29 May 2025 0 repositories listedChart question answering (CQA) has become a critical multimodal task for evaluating the reasoning capabilities of vision-language models.
-
ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models19 May 2025 0 repositories listedChart understanding presents a unique challenge for large vision-language models (LVLMs), as it requires the integration of sophisticated textual and visual reasoning capabilities.
-
DomainCQA: Crafting Expert-Level QA from Domain-Specific Charts25 Mar 2025 0 repositories listedChart Question Answering (CQA) benchmarks are essential for evaluating the capability of Multimodal Large Language Models (MLLMs) to interpret visual data.
-
Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering23 Mar 2025 0 repositories listedMisleading chart visualizations, which intentionally manipulate data representations to support specific claims, can distort perceptions and lead to incorrect conclusions.
-
ChartCitor: Multi-Agent Framework for Fine-Grained Chart Visual Attribution3 Feb 2025 0 repositories listed
-
RealCQA-V2 : Visual Premise Proving A Manual COT Dataset for Charts29 Oct 2024 0 repositories listed
-
ChartKG: A Knowledge-Graph-Based Representation for Chart Images13 Oct 2024 0 repositories listed
-
Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations27 Sep 2024 0 repositories listed
-
GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering4 Sep 2024 0 repositories listed
-
Advancing Chart Question Answering with Robust Chart Component Recognition19 Jul 2024 0 repositories listed
-
Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness15 Jul 2024 0 repositories listed
-
Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMs1 Jun 2024 0 repositories listed
-
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering11 May 2024 0 repositories listed
-
mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning2 Apr 2024 0 repositories listed
-
Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA25 Mar 2024 0 repositories listed
-
19 Mar 2024 0 repositories listed
-
1 Jan 2024 0 repositories listed
-
Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization17 Dec 2023 0 repositories listed
-
1 Dec 2023 0 repositories listed
-
Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairs29 May 2023 0 repositories listed
-
Chart Question Answering: State of the Art and Future Directions8 May 2022 0 repositories listed
-
STL-CQA: Structure-based Transformers with Localization and Encoding for Chart Question Answering1 Nov 2020 0 repositories listed
-
3 Sep 2019 0 repositories listed
-
30 Jul 2019 0 repositories listed
Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections