{"url":"/dataset/binette-s-2022-inventors-benchmark","name":"Binette's 2022 Inventors Benchmark","full_name":"Binette's 2022 Inventors Benchmark","description_markdown":"Hand-disambiguation of a sample of U.S. patents inventor mentions from PatentsView.org.\r\n\r\nInventors we selected indirectly by sampling inventor mentions uniformly at random. This results in inventor sampled with probability proportional to their number of granted patents.\r\n\r\nThe time period considered is from 1976 to December 31, 2021, corresponding to the disambiguation labeled \"disamb_inventor_id_20211230\" in PatentsView's bulk data downloads \"g_persistent_inventor.tsv\" file (https://patentsview.org/download/data-download-tables). That is, the benchmark disambiguation intends to contain all inventor mentions for the sampled inventors from that time period. Note that the benchmark disambiguation contains a few extraneous mentions to patents granted outside of that time period. These should be ignored for evaluation purposes.\r\n\r\nThe methodology used for the hand-disambiguation is described in Binette et al. (2022) (https://arxiv.org/abs/2210.01230). We used one disambiguation of 200 inventors from Binette et al. (2022), as well as an additional disambiguation of 200 inventors provided by an additional staff member. The two disambiguations were reviewed and validated. However, they should be expected to contain errors due to the ambiguous nature of inventor disambiguation. Furthermore, given the use as the December 30, 2021, disambiguation from PatentsView as a starting point of the hand-labeling, a bias towards this disambiguation should be expected.","description_withheld":null,"homepage":"https://github.com/PatentsView/PatentsView-Evaluation/","introduced_date":"2023-01-09","introduced_date_note":null,"introduced_by":{"paper":"/paper/patentsview-evaluation-evaluation-datasets","title":"PatentsView-Evaluation: Evaluation Datasets and Tools to Advance Research on Inventor Name Disambiguation","first_author":"Olivier Binette","url":null},"license":null,"modalities":[{"name":"Tabular","url":"/datasets/modality/tabular"}],"tasks":[{"name":"Entity Resolution","url":"/task/entity-resolution","datasets_with_task":"/datasets/task/entity-resolution"},{"name":"Record linking","url":"/task/record-linking","datasets_with_task":"/datasets/task/record-linking"}],"languages":[],"variants":["Binette's 2022 Inventors Benchmark"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}