Math

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

6 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 765 papers with code (1,596 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  28 Jan 2022 19 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning.
• AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  1 Jun 2023 12 repositories listed Syntology ran 12 of 18 samples · 6 unverified · 2 pointer-only (licence)
  We propose Activation-aware Weight Quantization (AWQ), a hardware-friendly approach for LLM low-bit weight-only quantization.
• GPT-4 Technical Report
  15 Mar 2023 11 repositories listed Syntology ran 2 of 5 samples · 3 unverified · 1 pointer-only (licence)
  We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs.
• Translating Math Formula Images to LaTeX Sequences Using Deep Neural Networks with Sequence-level Training
  29 Aug 2019 8 repositories listed
  The encoder is a convolutional neural network (CNN) that transforms images into a group of feature maps.
• ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools
  18 Jun 2024 7 repositories listed Syntology ran 15 of 29 samples · 14 unverified
  We introduce ChatGLM, an evolving family of large language models that we have been developing over time.
• PaLM: Scaling Language Modeling with Pathways
  5 Apr 2022 7 repositories listed Syntology ran 30 of 37 samples · 7 unverified
  To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model PaLM.
• Qwen2.5 Technical Report
  19 Dec 2024 6 repositories listed Syntology ran 1 of 3 samples · 2 unverified
  In addition, for hosted solutions, the proprietary models currently include two mixture-of-experts (MoE) variants: Qwen2.
• Mistral 7B
  10 Oct 2023 6 repositories listed Syntology ran 9 of 11 samples · 2 unverified · 1 pointer-only (licence)
  We introduce Mistral 7B v0.
• Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
  9 Jun 2022 6 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.
• Training Verifiers to Solve Math Word Problems
  27 Oct 2021 6 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  State-of-the-art language models can match human performance on many tasks, but they still struggle to robustly perform multi-step mathematical reasoning.
• Process Reinforcement through Implicit Rewards
  3 Feb 2025 5 repositories listed Syntology ran 2 of 17 samples · 15 unverified
  While dense rewards also offer an appealing choice for the reinforcement learning (RL) of LLMs since their fine-grained rewards have the potential to address some inherent issues of outcome rewards, such as training…
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
  5 Feb 2024 5 repositories listed Syntology ran 8 of 24 samples · 16 unverified
  Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature.
• Full Page Handwriting Recognition via Image to Sequence Extraction
  11 Mar 2021 5 repositories listed
  We present a Neural Network based Handwritten Text Recognition (HTR) model architecture that can be trained to recognize full pages of handwritten or printed text without image segmentation.
• Measuring Mathematical Problem Solving With the MATH Dataset
  5 Mar 2021 5 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  To facilitate future research and increase accuracy on MATH, we also contribute a large auxiliary pretraining dataset which helps teach models the fundamentals of mathematics.
• The Matrix Calculus You Need For Deep Learning
  5 Feb 2018 5 repositories listed
  This paper is an attempt to explain all the matrix calculus you need in order to understand the training of deep neural networks.
• MAMUT: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training
  28 Feb 2025 4 repositories listed
  Mathematical formulas are a fundamental and widely used component in various scientific fields, serving as a universal language for expressing complex concepts and relationships.
• Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learning
  20 Feb 2025 4 repositories listed Syntology ran 10 of 23 samples · 13 unverified
  Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in large reasoning models.
• On the Emergence of Thinking in LLMs I: Searching for the Right Intuition
  10 Feb 2025 4 repositories listed Syntology ran 0 of 13 samples · 13 unverified
  Lastly, we propose a theory as to why RLSP search strategy is more suitable for LLMs inspired by a remarkable result that says CoT provably increases computational power of LLMs, which grows as the number of steps in…
• MARIO Eval: Evaluate Your Math LLM with your Math LLM--A mathematical dataset evaluation toolkit
  22 Apr 2024 4 repositories listed Syntology ran 8 of 13 samples · 5 unverified · 13 pointer-only (licence)
  Large language models (LLMs) have been explored in a variety of reasoning tasks including solving of mathematical problems.
• StarCoder 2 and The Stack v2: The Next Generation
  29 Feb 2024 4 repositories listed
  Our large model, StarCoder2- 15B, significantly outperforms other models of comparable size.
• Llemma: An Open Language Model For Mathematics
  16 Oct 2023 4 repositories listed Syntology ran 6 of 8 samples · 2 unverified
  We present Llemma, a large language model for mathematics.
• How is ChatGPT's behavior changing over time?
  18 Jul 2023 4 repositories listed Syntology ran 2 of 6 samples · 4 unverified · 5 pointer-only (licence)
  We find that the performance and behavior of both GPT-3.
• Language Models are Multilingual Chain-of-Thought Reasoners
  6 Oct 2022 4 repositories listed
  Finally, we show that the multilingual reasoning abilities of language models extend to other tasks such as commonsense reasoning and word-in-context semantic judgment.
• Memorizing Transformers
  16 Mar 2022 4 repositories listed Syntology ran 20 of 34 samples · 14 unverified · 2 pointer-only (licence)
  Language models typically need to be trained or finetuned in order to acquire new knowledge, which involves updating their weights.
• TTRL: Test-Time Reinforcement Learning
  22 Apr 2025 3 repositories listed Syntology ran 7 of 16 samples · 9 unverified
  Furthermore, although TTRL is only supervised by the Maj@N metric, TTRL has demonstrated performance to consistently surpass the upper limit of the initial model, and approach the performance of models trained directly…
• xLSTM 7B: A Recurrent LLM for Fast and Efficient Inference
  17 Mar 2025 3 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  Recent breakthroughs in solving reasoning, math and coding problems with Large Language Models (LLMs) have been enabled by investing substantial computation budgets at inference time.
• ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates
  10 Feb 2025 3 repositories listed
  We train our ReasonFlux-32B model with only 8 GPUs and introduces three innovations: (i) a structured and generic thought template library, containing around 500 high-level thought templates capable of generalizing to…
• LIMO: Less is More for Reasoning
  5 Feb 2025 3 repositories listed
  While conventional wisdom suggests that sophisticated reasoning tasks demand extensive training data (>100, 000 examples), we demonstrate that complex mathematical reasoning abilities can be effectively elicited with…
• Kimi k1.5: Scaling Reinforcement Learning with LLMs
  22 Jan 2025 3 repositories listed Syntology ran 3 of 10 samples · 7 unverified
  Moreover, we present effective long2short methods that use long-CoT techniques to improve short-CoT models, yielding state-of-the-art short-CoT reasoning results -- e.
• rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  8 Jan 2025 3 repositories listed
  We present rStar-Math to demonstrate that small language models (SLMs) can rival or even surpass the math reasoning capability of OpenAI o1, without distillation from superior models.

Syntology lines on 21 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.