Browse State-of-the-Art › Mathematical Problem-Solving
Mathematical Problem-Solving
55 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 106 · with a code link: 55 · where Syntology ran a sample: 25 (16 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (25 of 106 tagged: 16 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 106, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Mar 2021 5 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)To facilitate future research and increase accuracy on MATH, we also contribute a large auxiliary pretraining dataset which helps teach models the fundamentals of mathematics.
-
4 Nov 2024 3 repositories listedIn this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of…
-
11 Jul 2024 3 repositories listedThe mathematical capabilities of Multi-modal Large Language Models (MLLMs) remain under-explored with three areas to be improved: visual encoding of math diagrams, diagram-language alignment, and chain-of-thought (CoT)…
-
26 Jun 2024 3 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)This paper investigates the mathematical problem-solving capabilities of LLMs using the newly developed "MathOdyssey" dataset.
-
3 Apr 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 1 pointer-only (licence)Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving.
-
18 Dec 2023 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)We first analyze the limitations of current Multimodal Large Language Models (MLLMs) in this area: they struggle to accurately comprehending basic geometric elements and their relationships.
-
9 Jun 2025 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 4 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)Inequality proving, crucial across diverse scientific and mathematical fields, tests advanced reasoning skills such as discovering tight bounds and strategic theorem application.
-
12 May 2025 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Large Language Models (LLMs) often struggle with mathematical reasoning tasks requiring precise, verifiable computation.
-
4 Jul 2025 1 repository listed Syntology official (archive's flag): 8 ran · 19 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 3 violated, 6 with no contract checked; 8 where Syntology's instrument failed) · 1 unverified (of 20 harvested samples) · 16 pointer-only (licence)Multi-agent systems (MAS) have emerged as a powerful paradigm for orchestrating large language models (LLMs) and specialized tools to collaboratively address complex tasks.
-
16 Jun 2025 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)Recent advances in large language models (LLMs), particularly those enhanced through reinforced post-training, have demonstrated impressive reasoning capabilities, as exemplified by models such as OpenAI o1 and…
-
10 Jun 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)A prerequisite for the scalability of RLVR is a high-quality problem set with precise and verifiable answers.
-
8 Jun 2025 1 repository listedLarge Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning…
-
5 Jun 2025 1 repository listedDespite rapid advances in vision-language models (VLMs), current benchmarks for multimodal reasoning fall short in three key dimensions.
-
28 May 2025 1 repository listedMathematical reasoning tasks have become prominent benchmarks for assessing the reasoning capabilities of LLMs, especially with reinforcement learning (RL) methods such as GRPO showing significant performance gains.
-
26 May 2025 1 repository listedLarge Language Models (LLMs) are prone to hallucination, especially during multi-hop and reasoning-intensive tasks such as mathematical problem solving.
-
26 May 2025 1 repository listedThe resulting GRPO approach, leveraging format-length surrogate signals, not only matches but surpasses the performance of the standard GRPO algorithm relying on ground truth answers in certain scenarios, achieving 40.
-
23 May 2025 1 repository listedIn addition, RaDeR presents the first dense retriever that outperforms BM25 when queries are Chain-of-Thought reasoning steps, underscoring the critical role of reasoning-based retrieval to augment reasoning language…
-
17 May 2025 1 repository listedLarge language models (LLMs) have shown remarkable progress in mathematical problem-solving, but evaluation has largely focused on problems that have exact analytical solutions or involve formal proofs, often…
-
14 May 2025 1 repository listedParameter-efficient fine-tuning (PEFT) methods have shown promise in adapting large language models, yet existing approaches exhibit counter-intuitive phenomena: integrating router into prompt tuning (PT) increases…
-
2 Apr 2025 1 repository listedThis study investigates the reasoning robustness of large language models (LLMs) on mathematical problem-solving tasks under systematically introduced input perturbations.
-
31 Mar 2025 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)The mathematical problem-solving capabilities of large language models have become a focal point of research, with growing interests in leveraging self-generated reasoning paths as a promising way to refine and enhance…
-
22 Mar 2025 1 repository listedFuture research should focus on interpretability, integration with domain-specific solvers, and improving the robustness of AI-driven decision-making.
-
21 Mar 2025 1 repository listedReasoning capabilities have significantly improved the performance of vision-language models (VLMs) in domains such as mathematical problem-solving, coding, and visual question-answering.
-
20 Mar 2025 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 1 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 5 unverified (of 18 harvested samples) · 3 pointer-only (licence)Large Language Models (LLMs) have shown impressive progress in mathematical reasoning.
-
19 Mar 2025 1 repository listedDespite impressive performance across diverse tasks, Multimodal Large Language Models (MLLMs) have yet to fully demonstrate their potential in visual mathematical problem-solving, particularly in accurately perceiving…
-
26 Feb 2025 1 repository listedIn coding tasks, Nexus-driven MASs achieve a 99% pass rate on HumanEval and a flawless 100% on VerilogEval-Human, outperforming cutting-edge reasoning language models such as o3-mini and DeepSeek-R1.
-
21 Feb 2025 1 repository listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Despite strong performance on vision-language tasks, Multimodal Large Language Models (MLLMs) struggle with mathematical problem-solving, with both open-source and state-of-the-art models falling short of human…
-
17 Feb 2025 1 repository listedThis paper introduces Code-Vision, a benchmark designed to evaluate the logical understanding and code generation capabilities of Multimodal Large Language Models (MLLMs).
-
16 Feb 2025 1 repository listedLarge Language Models (LLMs) have demonstrated impressive capabilities in natural language processing tasks, such as text generation and semantic understanding.
-
7 Feb 2025 1 repository listedLarge Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet their performance is highly dependent on the prompting strategy and model scale.
-
11 Jan 2025 1 repository listed
-
9 Jan 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
30 Dec 2024 1 repository listed
-
28 Dec 2024 1 repository listed
-
27 Nov 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
25 Nov 2024 1 repository listed
-
22 Oct 2024 1 repository listed
-
3 Oct 2024 1 repository listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
26 Sep 2024 1 repository listed
-
20 Aug 2024 1 repository listed
-
1 Jul 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
25 Jun 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
18 Jun 2024 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
-
18 Jun 2024 1 repository listed
-
29 May 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
23 Apr 2024 1 repository listed
-
19 Apr 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
30 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
26 Mar 2024 1 repository listed
-
12 Mar 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)
-
16 Oct 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
29 Sep 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 9 pointer-only (licence)
-
2 Jun 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
29 May 2023 1 repository listed
-
1 Apr 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving12 Jun 2025 0 repositories listed
-
PoLAR: Polar-Decomposed Low-Rank Adapter Representation3 Jun 2025 0 repositories listed
-
Evaluation of LLMs for mathematical problem solving30 May 2025 0 repositories listed
-
Can reasoning models comprehend mathematical problems in Chinese ancient texts? An empirical study based on data from Suanjing Shishu22 May 2025 0 repositories listed
-
SMART: Self-Generating and Self-Validating Multi-Dimensional Assessment for LLMs' Mathematical Problem Solving22 May 2025 0 repositories listed
-
Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problems21 May 2025 0 repositories listed
-
Reasoning with OmniThought: A Large CoT Dataset with Verbosity and Cognitive Difficulty Annotations16 May 2025 0 repositories listed
-
Is PRM Necessary? Problem-Solving RL Implicitly Induces PRM Capability in LLMs16 May 2025 0 repositories listed
-
Reasoning Models Can Be Effective Without Thinking14 Apr 2025 0 repositories listed
-
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models9 Apr 2025 0 repositories listed
-
LearNAT: Learning NL2SQL with AST-guided Task Decomposition for Large Language Models3 Apr 2025 0 repositories listed
-
On Vanishing Variance in Transformer Length Generalization3 Apr 2025 0 repositories listed
-
Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematics1 Apr 2025 0 repositories listed
-
MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection23 Mar 2025 0 repositories listed
-
Performance Comparison of Large Language Models on Advanced Calculus Problems5 Mar 2025 0 repositories listed
-
Self-Evolved Preference Optimization for Enhancing Mathematical Reasoning in Small Language Models4 Mar 2025 0 repositories listed
-
SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models25 Feb 2025 0 repositories listed
-
How Do Large Language Monkeys Get Their Power (Laws)?24 Feb 2025 0 repositories listed
-
Navigating Semantic Relations: Challenges for Language Models in Abstract Common-Sense Reasoning19 Feb 2025 0 repositories listed
-
MathFimer: Enhancing Mathematical Reasoning by Expanding Reasoning Steps through Fill-in-the-Middle Task17 Feb 2025 0 repositories listed
-
Scaling Autonomous Agents via Automatic Reward Modeling And Planning17 Feb 2025 0 repositories listed
-
STRIVE: Structured Reasoning for Self-Improvement in Claim Verification17 Feb 2025 0 repositories listed
-
Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving17 Feb 2025 0 repositories listed
-
Advancing Reasoning in Large Language Models: Promising Methods and Approaches5 Feb 2025 0 repositories listed
-
Automating Mathematical Proof Generation Using Large Language Model Agents and Knowledge Graphs4 Feb 2025 0 repositories listed
-
Token-Hungry, Yet Precise: DeepSeek R1 Highlights the Need for Multi-Step Reasoning Over Speed in MATH30 Jan 2025 0 repositories listed
-
Token-by-Token Regeneration and Domain Biases: A Benchmark of LLMs on Advanced Mathematical Problem-Solving28 Jan 2025 0 repositories listed
-
Kwai-STaR: Transform LLMs into State-Transition Reasoners7 Nov 2024 0 repositories listed
-
VisAidMath: Benchmarking Visual-Aided Mathematical Reasoning30 Oct 2024 0 repositories listed
-
Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks24 Oct 2024 0 repositories listed
-
FG-PRM: Fine-grained Hallucination Detection and Mitigation in Language Model Mathematical Reasoning8 Oct 2024 0 repositories listed
-
Can LLMs plan paths with extra hints from solvers?7 Oct 2024 0 repositories listed
-
PersonaMath: Enhancing Math Reasoning through Persona-Driven Data Augmentation2 Oct 2024 0 repositories listed
-
Building Math Agents with Multi-Turn Iterative Preference Learning4 Sep 2024 0 repositories listed
-
Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems29 Aug 2024 0 repositories listed
-
Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning16 Jun 2024 0 repositories listed
-
3D-Properties: Identifying Challenges in DPO and Charting a Path Forward11 Jun 2024 0 repositories listed
-
OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step4 Jun 2024 0 repositories listed
-
The Buffer Mechanism for Multi-Step Information Reasoning in Language Models24 May 2024 0 repositories listed
-
Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving20 May 2024 0 repositories listed
-
Mixture-of-Instructions: Comprehensive Alignment of a Large Language Model through the Mixture of Diverse System Prompting Instructions29 Apr 2024 0 repositories listed
-
Premise Order Matters in Reasoning with Large Language Models14 Feb 2024 0 repositories listed
-
Large Language Models for Mathematical Reasoning: Progresses and Challenges31 Jan 2024 0 repositories listed
-
Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning20 Oct 2023 0 repositories listed
-
SEGO: Sequential Subgoal Optimization for Mathematical Problem-Solving19 Oct 2023 0 repositories listed
Syntology lines on 26 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections