{"url":"/dataset/wdc-sotab","name":"WDC SOTAB","full_name":null,"description_markdown":"WDC SOTAB is a benchmark that features two annotation tasks: Column Type Annotation and Columns Property Annotation. The goal of the Column Type Annotation (CTA) task is to annotate the columns of a table with 91 Schema.org types, such as telephone, duration, Place, or Organization. The goal of the Columns Property Annotation (CPA) task is to annotate pairs of table columns with one out of 176 Schema.org properties, such as gtin13, startDate, priceValidUntil, or recipeIngredient. The benchmark consists of 59,548 tables annotated for CTA and 48,379 tables annotated for CPA originating from 74,215 different websites. The tables are split into training-, validation- and test sets for both tasks. The tables cover 17 popular Schema.org types including Product, LocalBusiness, Event, and JobPosting. The tables originate from the Schema.org Table Corpus.\r\n\r\nSome characteristics for the different tasks are provided in the table below, where \"Columns\" refers to the number of columns/column pairs labeled and \"Classes\" to the number of unique classes used for annotation.\r\n\r\n|                | Columns| Classes |\r\n|----------------|---------|---------|\r\n| Column Property Annotation  |  174,998  |  176 |\r\n| Column Type Annotation     | 162,351 | 91 |","description_withheld":null,"homepage":"http://webdatacommons.org/structureddata/sotab/","introduced_date":null,"introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[{"name":"Tabular","url":"/datasets/modality/tabular"}],"tasks":[{"name":"Data Integration","url":"/task/data-integration","datasets_with_task":"/datasets/task/data-integration"},{"name":"Table annotation","url":"/task/table-annotation","datasets_with_task":"/datasets/task/table-annotation"},{"name":"Column Type Annotation","url":"/task/column-type-annotation","datasets_with_task":"/datasets/task/column-type-annotation"},{"name":"Columns Property Annotation","url":"/task/columns-property-annotation","datasets_with_task":"/datasets/task/columns-property-annotation"}],"languages":[],"variants":["WDC SOTAB"],"data_loaders":[],"num_papers_in_archive":2,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/column-type-annotation-on-wdc-sotab","task":"Column Type Annotation","dataset_variant":"WDC SOTAB","rows":3,"metrics":["Micro F1","Weighted F1"],"first_row_in_archive_order":{"model":"DODUO","paper":"/paper/sotab-the-wdc-schema-org-table-annotation","metrics":{"Micro F1":"84.82"},"code_links":[{"title":"wbsg-uni-mannheim/wdc-sotab","url":"https://github.com/wbsg-uni-mannheim/wdc-sotab"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/columns-property-annotation-on-wdc-sotab","task":"Columns Property Annotation","dataset_variant":"WDC SOTAB","rows":2,"metrics":["Micro F1"],"first_row_in_archive_order":{"model":"DODUO","paper":"/paper/sotab-the-wdc-schema-org-table-annotation","metrics":{"Micro F1":"79.96"},"code_links":[{"title":"wbsg-uni-mannheim/wdc-sotab","url":"https://github.com/wbsg-uni-mannheim/wdc-sotab"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers_with_a_benchmark_row":[{"paper":"/paper/archetype-a-novel-framework-for-open-source","title":"ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Models","date":"2023-10-27","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-09-24T18:15:14+00:00","samples_harvested":12,"samples_ran":8,"samples_unverified":4,"pointer_only_for_licence":0,"claim":"Per-sample execution on synthesized fixtures; not a correctness claim."}},{"paper":"/paper/sotab-the-wdc-schema-org-table-annotation","title":"SOTAB: The WDC Schema.org Table Annotation Benchmark","date":"2023-01-09","rows_on_this_dataset":4,"code_links":1,"syntology":null}],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":1,"samples_harvested":12,"samples_ran":8,"samples_unverified":4,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}