{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-synthetic-dataset-for-personal-attribute","title":"A Synthetic Dataset for Personal Attribute Inference","arxiv_id":"2406.07217","date":"2024-06-11","proceeding":null,"authors":["Hanna Yukhymenko","Robin Staab","Mark Vero","Martin Vechev"],"abstract":"Recently, powerful Large Language Models (LLMs) have become easily accessible to hundreds of millions of users world-wide. However, their strong capabilities and vast world knowledge do not come without associated privacy risks. In this work, we focus on the emerging privacy threat LLMs pose -- the ability to accurately infer personal information from online texts. Despite the growing importance of LLM-based author profiling, research in this area has been hampered by a lack of suitable public datasets, largely due to ethical and privacy concerns associated with real personal data. We take two steps to address this problem: (i) we construct a simulation framework for the popular social media platform Reddit using LLM agents seeded with synthetic personal profiles; (ii) using this framework, we generate SynthPAI, a diverse synthetic dataset of over 7800 comments manually labeled for personal attributes. We validate our dataset with a human study showing that humans barely outperform random guessing on the task of distinguishing our synthetic comments from real ones. Further, we verify that our dataset enables meaningful personal attribute inference research by showing across 18 state-of-the-art LLMs that our synthetic comments allow us to draw the same conclusions as real-world data. Combined, our experimental results, dataset and pipeline form a strong basis for future privacy-preserving research geared towards understanding and mitigating inference-based privacy threats that LLMs pose.","url_abs":"https://arxiv.org/abs/2406.07217v2","url_pdf":"https://arxiv.org/pdf/2406.07217v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-synthetic-dataset-for-personal-attribute","repo_url":"https://github.com/eth-sri/synthpai","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"a-synthetic-dataset-for-personal-attribute","repo_url":"https://github.com/eth-sri/llm-anonymization","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"author-profiling","task_name":"Author Profiling"},{"task_slug":"personality-trait-recognition","task_name":"Personality Trait Recognition"},{"task_slug":"privacy-preserving","task_name":"Privacy Preserving"},{"task_slug":"synthetic-data-generation","task_name":"Synthetic Data Generation"},{"task_slug":"world-knowledge","task_name":"World Knowledge"},{"task_slug":"zero-shot-classification-unified-classes","task_name":"Zero-shot Classification (unified classes)"}],"methods":[{"method_slug":"cot-prompting","method_name":"CoT Prompting"},{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[{"slug":"synthpai","name":"SynthPAI","full_name":"SynthPAI: A Synthetic Dataset for Personal Attribute Inference"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"GPT-4","rank_in_archive_order":1,"of":18,"metrics":{"Average accuracy in %":"77.9%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"LLama-3 70B","rank_in_archive_order":2,"of":18,"metrics":{"Average accuracy in %":"72.2%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Mixtral 8x22B","rank_in_archive_order":3,"of":18,"metrics":{"Average accuracy in %":"72%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Claude-3 Opus","rank_in_archive_order":4,"of":18,"metrics":{"Average accuracy in %":"71.1%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Claude-3 Sonnet","rank_in_archive_order":5,"of":18,"metrics":{"Average accuracy in %":"70.9%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Gemini 1.5 Pro","rank_in_archive_order":6,"of":18,"metrics":{"Average accuracy in %":"67.5%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Qwen1.5 110B","rank_in_archive_order":7,"of":18,"metrics":{"Average accuracy in %":"65.7%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Gemini 1.0 Pro","rank_in_archive_order":8,"of":18,"metrics":{"Average accuracy in %":"64.6%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Claude-3 Haiku","rank_in_archive_order":9,"of":18,"metrics":{"Average accuracy in %":"64%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Yi 34B","rank_in_archive_order":10,"of":18,"metrics":{"Average accuracy in %":"57.7%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"LLama-2 70B","rank_in_archive_order":11,"of":18,"metrics":{"Average accuracy in %":"56.8%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"GPT-3.5","rank_in_archive_order":12,"of":18,"metrics":{"Average accuracy in %":"55.9%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"LLama-3 8B","rank_in_archive_order":13,"of":18,"metrics":{"Average accuracy in %":"53.5%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Mixtral 8x7B","rank_in_archive_order":14,"of":18,"metrics":{"Average accuracy in %":"52.3%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"LLama-2 13B","rank_in_archive_order":15,"of":18,"metrics":{"Average accuracy in %":"48.7%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Mistral 7B","rank_in_archive_order":16,"of":18,"metrics":{"Average accuracy in %":"42.4%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"Gemma 7B","rank_in_archive_order":17,"of":18,"metrics":{"Average accuracy in %":"34.9%"},"uses_additional_data":false},{"leaderboard":"/sota/personality-trait-recognition-on-synthpai","task":"Personality Trait Recognition","dataset":"SynthPAI","model":"LLama-2 7B","rank_in_archive_order":18,"of":18,"metrics":{"Average accuracy in %":"33%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.07217","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.07217"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/eth-sri/llm-anonymization","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/eth-sri/synthpai","reach":null}],"summary":{"ran_honours":1,"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1},"listed":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"63e3f3bd138014ac","entry":"compare_ages","repo":"eth-sri/synthpai","repo_kind":"official","path":"src/thread/eval_thread.py","file_url":"https://github.com/eth-sri/synthpai/blob/HEAD/src/thread/eval_thread.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"63e3f3bd138014ac"}},{"code_sha256_prefix":"a0936369faa9744b","entry":"get_paths","repo":"eth-sri/llm-anonymization","repo_kind":"listed","path":"src/anonymized/plot_anonymized.py","file_url":"https://github.com/eth-sri/llm-anonymization/blob/HEAD/src/anonymized/plot_anonymized.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0936369faa9744b"}},{"code_sha256_prefix":"5efab7bf520d5b17","entry":"load_data_from_paths","repo":"eth-sri/llm-anonymization","repo_kind":"listed","path":"src/anonymized/plot_anonymized.py","file_url":"https://github.com/eth-sri/llm-anonymization/blob/HEAD/src/anonymized/plot_anonymized.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5efab7bf520d5b17"}},{"code_sha256_prefix":"430e64bbf8eabbfc","entry":"method_to_name","repo":"eth-sri/llm-anonymization","repo_kind":"listed","path":"src/anonymized/plot_anonymized.py","file_url":"https://github.com/eth-sri/llm-anonymization/blob/HEAD/src/anonymized/plot_anonymized.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"430e64bbf8eabbfc"}},{"code_sha256_prefix":"eb6a12d058783ffd","entry":"parse_utility_answer","repo":"eth-sri/llm-anonymization","repo_kind":"listed","path":"src/anonymized/anonymized.py","file_url":"https://github.com/eth-sri/llm-anonymization/blob/HEAD/src/anonymized/anonymized.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eb6a12d058783ffd"}},{"code_sha256_prefix":"cfa3ed61b3c34083","entry":"prompt_user","repo":"eth-sri/llm-anonymization","repo_kind":"listed","path":"src/anonymized/evaluate_anonymization.py","file_url":"https://github.com/eth-sri/llm-anonymization/blob/HEAD/src/anonymized/evaluate_anonymization.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cfa3ed61b3c34083"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}