{"url":"/dataset/arqmath2","name":"ARQMath","full_name":null,"description_markdown":"The goal of ARQMath is to advance techniques for mathematical information retrieval, in particular, retrieving answers to mathematical questions (Task 1), and formula retrieval (Task 2).\r\nUsing the question posts from Math Stack Exchange, participating systems are given a question or a formula from a question and asked to return a ranked list of either potential answers to the question or potentially useful formulae (in the case of a formula query). Relevance is determined by the expected utility of each returned item. These tasks allow participating teams to explore leveraging math notation together with text to improve the quality of retrieval results.","description_withheld":null,"homepage":"https://www.cs.rit.edu/~dprl/ARQMath/","introduced_date":null,"introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[],"tasks":[{"name":"Math Information Retrieval","url":"/task/math-information-retrieval","datasets_with_task":"/datasets/task/math-information-retrieval"}],"languages":[],"variants":["ARQMath"],"data_loaders":[],"num_papers_in_archive":2,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/math-information-retrieval-on-arqmath2","task":"Math Information Retrieval","dataset_variant":"ARQMath","rows":2,"metrics":["P@10","MAP","NDCG","bpref"],"first_row_in_archive_order":{"model":"Approach0+ColBERT (reranking)","paper":"/paper/evaluating-token-level-and-passage-level","metrics":{"P@10":"0.276"},"code_links":[{"title":"approach0/math-dense-retrievers","url":"https://github.com/approach0/math-dense-retrievers"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers_with_a_benchmark_row":[{"paper":"/paper/evaluating-token-level-and-passage-level","title":"Evaluating Token-Level and Passage-Level Dense Retrieval Models for Math Information Retrieval","date":"2022-03-21","rows_on_this_dataset":2,"code_links":1,"syntology":null}],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}