{"url":"/dataset/paramawps","name":"ParaMAWPS","full_name":"Paraphrased Math Word Problem Solving Repository","description_markdown":"This repository contains the code, data, and models of the paper titled **\"Math Word Problem Solving by Generating Linguistic Variants of Problem Statements\"** published in the ***Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)***.\r\n\r\nThe work is outlined in a more detailed and expository manner in our Bachelor of Science (B.Sc.) thesis titled **\"Variational Mathematical Reasoning: Enhancing Math Word Problem Solvers with Linguistic Variants and Disentangled Attention\"** which can be accessed from the [Islamic University of Technology (IUT) Institutional Repository](http://103.82.172.44:8080/xmlui/).\r\n\r\n[](https://arxiv.org/abs/2306.13899)\r\n[](https://aclanthology.org/2023.acl-srw.49/)\r\n[](https://scholar.google.com/citations?view_op=view_citation&hl=en&user=4L_7vaoAAAAJ&citation_for_view=4L_7vaoAAAAJ:d1gkVwhDpl0C)\r\n[](https://www.researchgate.net/publication/372918265_Math_Word_Problem_Solving_by_Generating_Linguistic_Variants_of_Problem_Statements)\r\n[](https://huggingface.co/datasets/Starscream-11813/ParaMAWPS)\r\n\r\n[](https://aclanthology.org/2023.acl-srw.49.pdf)\r\n[](https://drive.google.com/file/d/1R-lB53BeaM-7XE0EoBZ5qfy-BSc61gup/view?usp=sharing)\r\n[](https://aclanthology.org/2023.acl-srw.49.mp4)\r\n[](https://drive.google.com/file/d/1FfexZxsKqL0mw2cUy7hTr4vhp7WBjhRW/view?usp=sharing)\r\n[](http://103.82.172.44:8080/xmlui/handle/123456789/2092)\r\n\r\n**License:** Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International\r\n\r\n[](http://creativecommons.org/licenses/by-nc-sa/4.0/)\r\n\r\n## Dataset\r\nIn order to download our dataset **PᴀʀᴀMAWPS**, please navigate to the [ParaMAWPS](https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/tree/main/ParaMAWPS) folder. We use an $80:10:10$ train-validation-test split for our **PᴀʀᴀMAWPS** dataset. The splits are available in `.json` format in the aforementioned folder.\r\n\r\n### Data Format\r\nEach row consists of a Math Word Problem (MWP). The table below describes what each column signifies.\r\n\r\nColumn Title | Description\r\n------------ | -------------\r\n`id` | The unique identification number of the sample. Seed problems have `id` size of $\\leq 4$, whereas, variant problems have `id` size of $> 4$. The last variant of a seed problem (generally with the `id` \"$16000i$\", where $i$ is the `id` of the seed problem) is the inverse variant of the seed problem.\r\n`original_text` | The problem statement of the MWP. The seed problems have the same problem statement as present in the Mᴀᴡᴘs dataset.\r\n`equation` | The equation with a variable \\\\(x\\\\) which solves the MWP\r\n`quantity_tagged_text` | The problem statement of the MWP, where each quantity is replaced with a unique tag \\\\([Q_i]\\\\)\r\n`quantity_tagged_equation` | The equation with a variable \\\\(x\\\\) which solves the MWP, but each quantity is replaced with its unique tag \\\\([Q_i]\\\\) in the problem statement\r\n`have_constant` | Whether the use of a constant value is required to solve the MWP
For an MWP sample \\\\(i\\\\) with `have_constant` label \\\\(C_i\\\\), the boolean label is,
$C_i =\\begin{cases} \\text{FALSE}, & \\text{if $i$ requires $0$ constant values}\\\\\\ \\text{TRUE}, & \\text{if $i$ requires $\\geq 1$ constant values}\\end{cases}$\r\n\r\n## Types of Variations\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_variationtypes.png\")
\r\n\r\n## Dataset Statistics\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_datasetcomparisontable.png\")
\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_datasetcomparisongraph.png\")
\r\n\r\n# Methodology\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_architecture2.png\")
\r\n\r\n# Results\r\nTo reproduce the results, please refer to the documentation of [MWPToolkit](https://github.com/LYH-YF/MWPToolkit) created by **Yihuai Lan _et al_**.\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_results.png\")
\r\n![\"drawing\"](\"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_ablation.png\")
\r\n\r\n## Citation\r\nIf you find this work useful, please cite our paper:\r\n```bib\r\n@inproceedings{raiyan-etal-2023-math,\r\n title = \"Math Word Problem Solving by Generating Linguistic Variants of Problem Statements\",\r\n author = \"Raiyan, Syed Rifat and\r\n Faiyaz, Md Nafis and\r\n Kabir, Shah Md. Jawad and\r\n Kabir, Mohsinul and\r\n Mahmud, Hasan and\r\n Hasan, Md Kamrul\",\r\n booktitle = \"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)\",\r\n month = jul,\r\n year = \"2023\",\r\n address = \"Toronto, Canada\",\r\n publisher = \"Association for Computational Linguistics\",\r\n url = \"https://aclanthology.org/2023.acl-srw.49\",\r\n doi = \"10.18653/v1/2023.acl-srw.49\",\r\n pages = \"362--378\",\r\n abstract = \"The art of mathematical reasoning stands as a fundamental pillar of intellectual progress and is a central catalyst in cultivating human ingenuity. Researchers have recently published a plethora of works centered around the task of solving Math Word Problems (MWP) {---} a crucial stride towards general AI. These existing models are susceptible to dependency on shallow heuristics and spurious correlations to derive the solution expressions. In order to ameliorate this issue, in this paper, we propose a framework for MWP solvers based on the generation of linguistic variants of the problem text. The approach involves solving each of the variant problems and electing the predicted expression with the majority of the votes. We use DeBERTa (Decoding-enhanced BERT with disentangled attention) as the encoder to leverage its rich textual representations and enhanced mask decoder to construct the solution expressions. Furthermore, we introduce a challenging dataset, ParaMAWPS, consisting of paraphrased, adversarial, and inverse variants of selectively sampled MWPs from the benchmark Mawps dataset. We extensively experiment on this dataset along with other benchmark datasets using some baseline MWP solver models. We show that training on linguistic variants of problem statements and voting on candidate predictions improve the mathematical reasoning and robustness of the model. We make our code and data publicly available.\",\r\n}\r\n```\r\n\r\nYou can also cite our thesis:\r\n```bib\r\n@phdthesis{raiyan2023variational,\r\n type={Bachelor's Thesis},\r\n title={Variational Mathematical Reasoning: Enhancing Math Word Problem Solvers with Linguistic Variants and Disentangled Attention},\r\n author={Raiyan, Syed Rifat and Faiyaz, Md Nafis and Kabir, Shah Md Jawad},\r\n year={2023},\r\n school={Department of Computer Science and Engineering (CSE), Islamic University of Technology},\r\n address={Board Bazar, Gazipur-1704, Dhaka, Bangladesh},\r\n note={Available at \\url{http://103.82.172.44:8080/xmlui/handle/123456789/2092}}\r\n}\r\n```","description_withheld":null,"homepage":"https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/","introduced_date":"2023-06-24","introduced_date_note":null,"introduced_by":{"paper":"/paper/math-word-problem-solving-by-generating","title":"Math Word Problem Solving by Generating Linguistic Variants of Problem Statements","first_author":"Syed Rifat Raiyan","url":null},"license":{"name":"Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International","url":"http://creativecommons.org/licenses/by-nc-sa/4.0/"},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Mathematical Reasoning","url":"/task/mathematical-reasoning","datasets_with_task":"/datasets/task/mathematical-reasoning"},{"name":"Mathematical Question Answering","url":"/task/mathematical-question-answering","datasets_with_task":"/datasets/task/mathematical-question-answering"},{"name":"Math Word Problem Solving","url":"/task/math-word-problem-solving","datasets_with_task":"/datasets/task/math-word-problem-solving"},{"name":"Math Word Problem SolvingΩ","url":"/task/math-word-problem-solvingo","datasets_with_task":"/datasets/task/math-word-problem-solvingo"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["ParaMAWPS"],"data_loaders":[{"repo":"https://github.com/huggingface/datasets","url":"https://huggingface.co/datasets/Starscream-11813/ParaMAWPS","frameworks":["tf","pytorch","jax"]}],"num_papers_in_archive":2,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/math-word-problem-solving-on-paramawps","task":"Math Word Problem Solving","dataset_variant":"ParaMAWPS","rows":6,"metrics":["Accuracy (%)"],"first_row_in_archive_order":{"model":"DeBERTa (VM)","paper":"/paper/math-word-problem-solving-by-generating","metrics":{"Accuracy (%)":"79.1"},"code_links":[{"title":"starscream-11813/variational-mathematical-reasoning","url":"https://github.com/starscream-11813/variational-mathematical-reasoning"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers_with_a_benchmark_row":[{"paper":"/paper/math-word-problem-solving-by-generating","title":"Math Word Problem Solving by Generating Linguistic Variants of Problem Statements","date":"2023-06-24","rows_on_this_dataset":5,"code_links":1,"syntology":null},{"paper":"/paper/deberta-decoding-enhanced-bert-with","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","date":"2020-06-05","rows_on_this_dataset":1,"code_links":14,"syntology":{"read_at":"2026-09-24T18:15:14+00:00","samples_harvested":13,"samples_ran":4,"samples_unverified":9,"pointer_only_for_licence":3,"claim":"Per-sample execution on synthesized fixtures; not a correctness claim."}}],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":1,"samples_harvested":13,"samples_ran":4,"samples_unverified":9,"pointer_only_for_licence":3,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}