{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-05099","title":"ARC-TGI: Human-Validated Task Generators with Reasoning Chain Templates for ARC-AGI","arxiv_id":"2603.05099","date":"2026-03-05","proceeding":null,"authors":["Jens Lehmann","Syeda Khushbakht","Nikoo Salehfard","Nur A Zarin Nishat","Dhananjay Bhandiwad","Andrei Aioanei","Sahar Vahdati"],"abstract":"The Abstraction and Reasoning Corpus (ARC-AGI) probes few-shot abstraction and rule induction on small visual grids, but progress is difficult to measure on static collections of hand-authored puzzles due to overfitting, dataset leakage, and memorisation. We introduce ARC-TGI (ARC Task Generators Inventory), an open-source framework for task-family generators: compact Python programs that sample diverse ARC-AGI tasks while preserving a latent rule. ARC-TGI is built around a solver-facing representation: each generated task is paired with natural-language input and transformation reasoning chains and partially evaluated Python code implementing sampling, transformation, and episode construction. Crucially, ARC-TGI supports task-level constraints so that training examples collectively expose the variations needed to infer the underlying rule, a requirement for human-solvable ARC tasks that independent per-example sampling often fails to guarantee. All generators undergo human refinement and local verification to keep both grids and reasoning traces natural and consistent under variation. We release 461 generators covering 180 ARC-Mini tasks, 215 ARC-AGI-1 tasks (200 train, 15 test), and 66 ARC-AGI-2 tasks (55 train, 11 test), enabling scalable dataset sampling and controlled benchmarking.","url_abs":"https://arxiv.org/abs/2603.05099","url_pdf":"https://arxiv.org/pdf/2603.05099","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2603.05099","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.05099"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory","reach":null}],"summary":{"ran":3,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"169b8ddb839a4409","entry":"ARCDataEncoder","repo":"Omega-Reasoning/ARC-Task-Generators-Inventory","repo_kind":"found_in_text","path":"Framework/arc_task_generator.py","file_url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory/blob/HEAD/Framework/arc_task_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"169b8ddb839a4409"}},{"code_sha256_prefix":"351a281be99ee46a","entry":"ARCTask","repo":"Omega-Reasoning/ARC-Task-Generators-Inventory","repo_kind":"found_in_text","path":"Framework/arc_task_generator.py","file_url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory/blob/HEAD/Framework/arc_task_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"351a281be99ee46a"}},{"code_sha256_prefix":"52ab73473d05a04f","entry":"GridPair","repo":"Omega-Reasoning/ARC-Task-Generators-Inventory","repo_kind":"found_in_text","path":"Framework/arc_task_generator.py","file_url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory/blob/HEAD/Framework/arc_task_generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"52ab73473d05a04f"}},{"code_sha256_prefix":"62ca6bd16c8c88ea","entry":"ARCTaskGenerator","repo":"Omega-Reasoning/ARC-Task-Generators-Inventory","repo_kind":"found_in_text","path":"Framework/arc_task_generator.py","file_url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory/blob/HEAD/Framework/arc_task_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"62ca6bd16c8c88ea"}},{"code_sha256_prefix":"bd67c359bfc19761","entry":"TrainTestData","repo":"Omega-Reasoning/ARC-Task-Generators-Inventory","repo_kind":"found_in_text","path":"Framework/arc_task_generator.py","file_url":"https://github.com/Omega-Reasoning/ARC-Task-Generators-Inventory/blob/HEAD/Framework/arc_task_generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bd67c359bfc19761"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,795 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6795},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}