{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-15189","title":"ScrapeGraphAI-100k: Dataset for Schema-Constrained LLM Generation","arxiv_id":"2602.15189","date":"2026-02-16","proceeding":null,"authors":["William Brach","Francesco Zuppichini","Marco Vinciguerra","Lorenzo Padoan"],"abstract":"Producing output that conforms to a specified JSON schema underlies tool use, structured extraction, and knowledge base construction in modern large language models. Despite this centrality, public datasets for the task remain small, synthetic, or text-only, and rarely pair real page content with the prompts and schemas used in practice. We introduce ScrapeGraphAI-100k, 93,695 schema-constrained extraction events collected via opt-in ScrapeGraphAI telemetry in Q2--Q3 2025, deduplicated and balanced by schema from 9M raw events. The corpus spans 18 000+ unique schemas across 15 named languages plus a long-tail Other category, with English and Traditional Chinese covering 88% of detected content, each instance pairs Markdown-converted page content with a prompt, schema, LLM response, and per-example jsonschema-rs structural conformance labels (semantic correctness is out of scope, and raw HTML is deferred beyond v1.0). We characterize structural diversity across the corpus and identify sharp failure thresholds as schema complexity grows. As a case study, a 1.7B student fine-tuned on this data closely tracks the output distribution of its GPT-5-nano teacher, though it still trails a 30B-A3B reference (3.3B active parameters) on schema compliance. We offer this distillation result as preliminary evidence that grounding schema-constrained generation in real practitioner workloads at scale enables training and benchmarking that prior synthetic or text-only corpora could not support.","url_abs":"https://arxiv.org/abs/2602.15189","url_pdf":"https://arxiv.org/pdf/2602.15189","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.15189","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.15189"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper","reach":null}],"summary":{"unverified":14},"by_repo_kind":{"found_in_text":{"samples":14,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"e4642fbe4e9a07a4","entry":"build","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/prompts.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/prompts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e4642fbe4e9a07a4"}},{"code_sha256_prefix":"bb93f1d464340939","entry":"build_calibration_dataset","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/convert_awq.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/convert_awq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bb93f1d464340939"}},{"code_sha256_prefix":"9cca23f2500b9d75","entry":"build_prompt","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/convert_awq.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/convert_awq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9cca23f2500b9d75"}},{"code_sha256_prefix":"24cfa0488aea2d8d","entry":"chunk_in_chars","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/preprocess.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/preprocess.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"24cfa0488aea2d8d"}},{"code_sha256_prefix":"33ac81ed9ca06c30","entry":"chunk_in_tokens","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/preprocess.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/preprocess.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"33ac81ed9ca06c30"}},{"code_sha256_prefix":"5147ae4d5ab0d49b","entry":"convert_to_f16_gguf","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/convert_gguf.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/convert_gguf.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5147ae4d5ab0d49b"}},{"code_sha256_prefix":"4f5713d837129797","entry":"infer_one","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/evaluation_llamacpp.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/evaluation_llamacpp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f5713d837129797"}},{"code_sha256_prefix":"12b7ca9d94bba202","entry":"jsonl_path","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/regenerate.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/regenerate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"12b7ca9d94bba202"}},{"code_sha256_prefix":"4487ecd85c7fa6bd","entry":"output_jsonl_path","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/regenerate.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/regenerate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4487ecd85c7fa6bd"}},{"code_sha256_prefix":"72248e066670068f","entry":"parse_json_remove_duplicates","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/metrics.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"72248e066670068f"}},{"code_sha256_prefix":"1a66dec272aa53c0","entry":"resolve_model","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/convert_awq.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/convert_awq.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1a66dec272aa53c0"}},{"code_sha256_prefix":"970696d5ceba99b8","entry":"start_server","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/evaluation_llamacpp.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/evaluation_llamacpp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"970696d5ceba99b8"}},{"code_sha256_prefix":"bf1214220a7dc429","entry":"state_path","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/regenerate.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/regenerate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf1214220a7dc429"}},{"code_sha256_prefix":"759fef2d0a6008ff","entry":"wait_for_server","repo":"ScrapeGraphAI/scrapegraph-100k-paper","repo_kind":"found_in_text","path":"modelling/evaluation_llamacpp.py","file_url":"https://github.com/ScrapeGraphAI/scrapegraph-100k-paper/blob/HEAD/modelling/evaluation_llamacpp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"759fef2d0a6008ff"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}