Datasets › MGSM

MGSM (Multilingual Grade School Math)

Introduced by Freda Shi et al. in Language Models are Multilingual Chain-of-Thought Reasoners6 Oct 2022 archive 2025-07-28

Multilingual Grade School Math Benchmark (MGSM) is a benchmark of grade-school math problems. The same 250 problems from GSM8K are each translated via human annotators in 10 languages. GSM8K (Grade School Math 8K) is a dataset of 8.5K high-quality linguistically diverse grade school math word problems. The dataset was created to support the task of question answering on basic mathematical problems that require multi-step reasoning.

Homepage Benchmarks Papers JSON

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

		First row (archive order)	Paper	Code
Multi-task Language Understanding	MGSM	PaLM 2 (few-shot, k=8, SC) Average (%) 87.0	PaLM 2 Technical Report	eternityyw/tram-benchmark	12	Compare

Papers archive 2025-07-28

4 shown of 4 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 107. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

			Date	Samples run Syntology
PaLM 2 Technical Report	1	2	17 May 2023	not harvested
Transcending Scaling Laws with 0.1% Extra Compute	0	1	20 Oct 2022	not harvested
Scaling Instruction-Finetuned Language Models	9	8	20 Oct 2022	ran 8 of 17 samples (9 unverified; 2 pointer-only for licence)
PaLM: Scaling Language Modeling with Pathways	7	1	5 Apr 2022	ran 30 of 37 samples (7 unverified)

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

Math Word Problem Solving Multi-task Language Understanding Arithmetic Reasoning

License archive 2025-07-28

Creative Commons Attribution-ShareAlike 4.0 International Public License

Modalities archive 2025-07-28

Texts

Languages archive 2025-07-28

English French Spanish German Chinese Bengali Japanese Russian Telugu Thai Swahili

Variants archive 2025-07-28

MGSM

1 variant name, as the archive lists them.

At a glance archive 2025-07-28

Introduced: 6 Oct 2022
Papers: 107
Benchmarks: 1
With a result: 4
Licence: Creative Commons Attribution-ShareAlike 4.0 International Public License
Modalities: Texts
Languages: English, French, Spanish, German, Chinese, Bengali, Japanese, Russian, Telugu, Thai, Swahili
Homepage: google-research/url-nlp

Samples run Syntology

Of the 4 papers with a result here, 2 have harvested code samples in Syntology's graph. Summed over those: Syntology ran 38 of 54 samples; 16 unverified; 2 pointer-only for licence. 0 of the 2 have no sample that ran. Each row in the Papers table states its own "ran N of M samples" with the unverified count; a sample that ran executed on a synthesized fixture, which is not a correctness claim about any result. Read from the graph 2026-09-24.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections