{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-09865","title":"LLM-as-a-Discriminator: When Synthetic Tables Still Look Real","arxiv_id":"2606.09865","date":"2026-06-01","proceeding":null,"authors":["Manel Slokom","Malek Slokom","Thierno Kante"],"abstract":"Privacy and data sharing are often in tension. Many organizations use synthetic data to reduce privacy risk and still share useful data. For tabular data, auditing privacy remains hard. In many cases, even humans cannot easily tell if a table is real or synthetic. In this paper, we propose a method based on LLM discrimination. We ask an LLM to classify each table sample as REAL or SYNTHETIC. We test two settings: C1 with table only, and C2 with table plus distributional metadata. We use LLaMA as an open model and Gemini as a reference model. In our experiments, we run three synthesis models, CTGAN, TVAE, and Gaussian Copula, on two public datasets, UCI Adult and ACS Census. We collect 451 valid trials. Our results show clear differences between models. On Adult, LLaMA reaches DRS=0% in reported cells, while Gemini reaches DRS=100% for CTGAN and TVAE. On Census, LLaMA predicts SYNTHETIC for most samples, while Gemini stays high in C1 but drops for CTGAN and TVAE in C2. We also compare with a classifier two-sample test (C2ST) and record linkage as distributional baselines, and with a human pilot of 2 annotators and 240 trials. Our results show that LLM discrimination is a practical privacy audit signal when model choice, per provider reporting, and data encoding are handled with care. For reproducibility, code and experiment scripts are available at https://github.com/SlokomManel/LLM-as-a-Discriminator.","url_abs":"https://arxiv.org/abs/2606.09865","url_pdf":"https://arxiv.org/pdf/2606.09865","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.09865","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.09865"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/SlokomManel/LLM-as-a-Discriminator","reach":null}],"summary":{"ran_violates":1,"ran_fixture":1,"ran_draft_wrong":2,"unverified":7},"by_repo_kind":{"found_in_text":{"samples":11,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6d0a4f28c66011af","entry":"_is_quota_error","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d0a4f28c66011af"}},{"code_sha256_prefix":"add56714fd2d46c7","entry":"build_prompt_c1","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"add56714fd2d46c7"}},{"code_sha256_prefix":"510a41a47044ed3e","entry":"extract_metadata","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"510a41a47044ed3e"}},{"code_sha256_prefix":"f6dc779efe98dad3","entry":"metadata_to_text","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6dc779efe98dad3"}},{"code_sha256_prefix":"e194463efa1df311","entry":"build_prompt_c2","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e194463efa1df311"}},{"code_sha256_prefix":"1cbb0091511cf939","entry":"call_anthropic","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1cbb0091511cf939"}},{"code_sha256_prefix":"b6f921f6a9949951","entry":"call_github_models","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6f921f6a9949951"}},{"code_sha256_prefix":"538cb132e17633b4","entry":"call_google","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"538cb132e17633b4"}},{"code_sha256_prefix":"9692ab58ac3057b5","entry":"call_groq","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9692ab58ac3057b5"}},{"code_sha256_prefix":"25d0149b1ef798f7","entry":"call_openai","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25d0149b1ef798f7"}},{"code_sha256_prefix":"62ec72f6139cbf5b","entry":"run_trial","repo":"SlokomManel/LLM-as-a-Discriminator","repo_kind":"found_in_text","path":"code/evaluate.py","file_url":"https://github.com/SlokomManel/LLM-as-a-Discriminator/blob/HEAD/code/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"62ec72f6139cbf5b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}