{"url":"/dataset/scientific-statement-classification-dataset","name":"Scientific statement classification dataset from arXMLiv 08.2018","full_name":null,"description_markdown":"This resource contains 10.5 million paragraphs with associated statement labels, realized as one paragraph per file, one sentence per line. Each file is placed in a subdirectory named after its annotated class. The statements were extracted from author-annotated environments, where we only selected the first paragraph,immediately following the heading. Headings include both structural sections (e.g. Introduction), as well as scholarly statement annotations, (e.g. Definition, Proof, Remark).\r\n\r\nThe annotated statement dataset is derived from arXMLiv, a machine-readable HTML5 representation of the arXiv corpus of scientific articles.\r\n\r\n### Examples\r\n\r\nDefinition with math lexemes (main data, single sentence, linebreaks for readability):\r\n```\r\na directed quantum turing automaton is a quadruple\r\n  italic_T RELOP_equals OPEN_( caligraphic_H PUNCT_, caligraphic_K PUNCT_, caligraphic_L PUNCT_, italic_tau CLOSE_) PUNCT_,\r\nwhere\r\n  caligraphic_H caligraphic_K and caligraphic_L\r\nare finite dimensional hilbert spaces over the complex field blackboard_C and\r\n  italic_tau METARELOP_colon caligraphic_H MULOP_tensor_product caligraphic_K ARROW_rightarrow\r\n    caligraphic_H MULOP_tensor_product caligraphic_L\r\nis an isometry in fdhilb\r\n```\r\n\r\nsource: `definition/1e4a1aea317bbf363c5314fb25eaf72c8a350a1007bb8aafc542e188405b93d5.txt`\r\n\r\nSame definition without math lexemes (nomath data, single sentence, linebreaks for readability):\r\n```\r\na directed quantum turing automaton is a quadruple\r\n  where and are finite dimensional hilbert spaces over the complex field and\r\n  is an isometry in fdhilb\r\n```\r\n\r\nnomath source: `definition/35b170bae4259a5c430846116142d4e4a45097e52daf818b78ea378d94d14a21.txt`","description_withheld":null,"homepage":"https://sigmathling.kwarc.info/resources/arxmliv-statements-082018/","introduced_date":"2019-08-29","introduced_date_note":null,"introduced_by":{"paper":"/paper/scientific-statement-classification-over","title":"Scientific Statement Classification over arXiv.org","first_author":"Deyan Ginev","url":null},"license":{"name":"SIGMathLing members, research-only","url":"https://sigmathling.kwarc.info/nda/"},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Text Classification","url":"/task/text-classification","datasets_with_task":"/datasets/task/text-classification"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["Scientific statement classification dataset from arXMLiv 08.2018"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-25T09:33:49+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}