{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-18966","title":"Self-Improving Tabular Language Models via Iterative Reward-Guided Post-Training","arxiv_id":"2604.18966","date":"2026-04-21","proceeding":null,"authors":["Yunbo Long","Tejumade Afonja","Guangya Hao","Alexandra Brintrup","Mario Fritz"],"abstract":"Tabular language models can generate synthetic tables by modeling rows as token sequences, but they are typically trained once with supervised fine-tuning and then used as static synthesizers. This is limiting because next-token likelihood does not directly optimize the distributional, utility, and indistinguishability properties used to evaluate synthetic data. We study iterative reward-guided post-training for tabular language models through a generate--score--align protocol, where a generator samples synthetic rows, a task-specified reward ranks them, and the model is updated relative to a fixed supervised reference. Within this protocol, we propose \\textbf{TabGRAA} (\\textbf{Tab}ular \\textbf{G}roup-\\textbf{R}elative \\textbf{A}dvantage \\textbf{A}lignment), a group-relative alignment method that compares high- and low-reward generated groups using group-averaged policy/reference log-ratios rather than one-to-one preference pairs. Across five mixed-type benchmarks, TabGRAA improves a GReaT backbone beyond additional supervised fine-tuning and achieves the strongest average trade-off among adapted DPO, KTO, and NPO baselines on fidelity and downstream utility, while maintaining empirical privacy diagnostics near the supervised baseline. Ablations show that the gains depend on meaningful reward ranking and stable group-level updates rather than extra training alone. Reward-substitution and scorer-separation studies further show that the post-training loop can use both classifier-based and classifier-free rewards, and that proper scorer separation is important for preserving the fidelity--utility--privacy trade-off. These results position TabGRAA as a self-improving post-training method for tabular language-model generators, complementary to strong static tabular synthesizers.","url_abs":"https://arxiv.org/abs/2604.18966","url_pdf":"https://arxiv.org/pdf/2604.18966","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.18966","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.18966"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models","reach":null}],"summary":{"ran":1,"unverified":6},"by_repo_kind":{"found_in_text":{"samples":7,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e0e546de505d2d71","entry":"load_data","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"eval/mle/tabular_dataload.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/eval/mle/tabular_dataload.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0e546de505d2d71"}},{"code_sha256_prefix":"1b5ebc195ff8697c","entry":"add_space_before_string","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"baselines/great/post_process.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/baselines/great/post_process.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b5ebc195ff8697c"}},{"code_sha256_prefix":"5aa6cff234d655cd","entry":"dpo_loss","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"loss.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5aa6cff234d655cd"}},{"code_sha256_prefix":"3fe471fa481a99fb","entry":"row_to_str","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"generate_dpo_synthetic.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/generate_dpo_synthetic.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3fe471fa481a99fb"}},{"code_sha256_prefix":"f533df6c960cab53","entry":"score_classifier","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"reward_scorers.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/reward_scorers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f533df6c960cab53"}},{"code_sha256_prefix":"2c871f7a5561f413","entry":"score_dcr","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"reward_scorers.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/reward_scorers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c871f7a5561f413"}},{"code_sha256_prefix":"8973105894e603d8","entry":"score_density","repo":"Yunbo-max/Post-Training-Tabular-Language-Models","repo_kind":"found_in_text","path":"reward_scorers.py","file_url":"https://github.com/Yunbo-max/Post-Training-Tabular-Language-Models/blob/HEAD/reward_scorers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8973105894e603d8"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}