Datasets › PolyMATH

PolyMATH

Introduced by Himanshu Gupta et al. in Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark6 Oct 2024 archive 2025-07-28

PolyMATH, a challenging benchmark aimed at evaluating the general cognitive reasoning abilities of MLLMs. PolyMATH comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning

Paper

Code

Project

Homepage JSON

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 1 paper for it but never published that list.

Dataset loaders archive 2025-07-28

huggingface.co/datasets/him1411/polymath huggingface/datasetstfpytorchjax

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

Mathematical Reasoning Logical Reasoning Visual Reasoning Visual Commonsense Reasoning Arithmetic Reasoning Multimodal Reasoning

License archive 2025-07-28

Academic Free License v3.0

Modalities archive 2025-07-28

Images Texts

Languages archive 2025-07-28

English

Variants archive 2025-07-28

PolyMATH

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections