{"url":"/dataset/pubtables-1m","name":"PubTables-1M","full_name":"PubMed Tables One Million","description_markdown":"The goal of PubTables-1M is to create a large, detailed, high-quality dataset for training and evaluating a wide variety of models for the tasks of **table detection**, **table structure recognition**, and **functional analysis**. It contains:\r\n\r\n- 460,589 annotated document pages containing tables for table detection.\r\n- 947,642 fully annotated tables including text content and complete location (bounding box) information for table structure recognition and functional analysis.\r\n- Full bounding boxes in both image and PDF coordinates for all table rows, columns, and cells (including blank cells), as well as other annotated structures such as column headers and projected row headers.\r\n- Rendered images of all tables and pages.\r\n- Bounding boxes and text for all words appearing in each table and page image.\r\n- Additional cell properties not used in the current model training.\r\n\r\nAdditionally, cells in the headers are *canonicalized* and we implement multiple *quality control* steps to ensure the annotations are as free of noise as possible. For more details, please see [our paper](https://arxiv.org/pdf/2110.00061.pdf).","description_withheld":null,"homepage":"https://msropendata.com/datasets/505fcbe3-1383-42b1-913a-f651b8b712d3","introduced_date":"2021-09-30","introduced_date_note":null,"introduced_by":{"paper":"/paper/scientific-evidence-extraction","title":"PubTables-1M: Towards comprehensive table extraction from unstructured documents","first_author":"Brandon Smock","url":null},"license":{"name":"Community Data License Agreement – Permissive, Version 1.0","url":"https://msropendata-web-api.azurewebsites.net/licenses/51259f77-12fd-47b4-8efe-a5b3344767ae/view"},"modalities":[{"name":"Images","url":"/datasets/modality/images"},{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Table Recognition","url":"/task/table-recognition","datasets_with_task":"/datasets/task/table-recognition"},{"name":"Table Detection","url":"/task/table-detection","datasets_with_task":"/datasets/task/table-detection"},{"name":"Table Functional Analysis","url":"/task/table-functional-analysis","datasets_with_task":"/datasets/task/table-functional-analysis"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["PubTables-1M"],"data_loaders":[{"repo":"https://github.com/microsoft/table-transformer","url":"https://github.com/microsoft/table-transformer","frameworks":[]},{"repo":"https://github.com/phamquiluan/table-transformer","url":"https://github.com/phamquiluan/table-transformer","frameworks":["pytorch"]}],"num_papers_in_archive":15,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}