{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-11362","title":"PersonaX: Multimodal Datasets with LLM-Inferred Behavior Traits","arxiv_id":"2509.11362","date":"2025-09-14","proceeding":"ICLR","authors":["Loka Li","Wong Yu Kang","Minghao Fu","Guangyi Chen","Zhenhao Chen","Gongxu Luo","Yuewen Sun","Salman Khan","Peter Spirtes","Kun Zhang"],"abstract":"Understanding human behavior traits is central to applications in human-computer interaction, computational social science, and personalized AI systems. Such understanding often requires integrating multiple modalities to capture nuanced patterns and relationships. However, existing resources rarely provide datasets that combine behavioral descriptors with complementary modalities such as facial attributes and biographical information. To address this gap, we present PersonaX, a curated collection of multimodal datasets designed to enable comprehensive analysis of public traits across modalities. PersonaX consists of (1) CelebPersona, featuring 9444 public figures from diverse occupations, and (2) AthlePersona, covering 4181 professional athletes across 7 major sports leagues. Each dataset includes behavioral trait assessments inferred by three high-performing large language models, alongside facial imagery and structured biographical features. We analyze PersonaX at two complementary levels. First, we abstract high-level trait scores from text descriptions and apply five statistical independence tests to examine their relationships with other modalities. Second, we introduce a novel causal representation learning (CRL) framework tailored to multimodal and multi-measurement data, providing theoretical identifiability guarantees. Experiments on both synthetic and real-world data demonstrate the effectiveness of our approach. By unifying structured and unstructured analysis, PersonaX establishes a foundation for studying LLM-inferred behavioral traits in conjunction with visual and biographical attributes, advancing multimodal trait analysis and causal reasoning. The code is available at https://github.com/lokali/PersonaX.","url_abs":"https://arxiv.org/abs/2509.11362","url_pdf":"https://arxiv.org/pdf/2509.11362","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.11362","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.11362"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/lokali/PersonaX","reach":null}],"summary":{"ran":5,"ran_draft_wrong":2,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"efbe04e87150fe98","entry":"EstimateE","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"efbe04e87150fe98"}},{"code_sha256_prefix":"a0d317a699486ec4","entry":"PerDimMLP","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a0d317a699486ec4"}},{"code_sha256_prefix":"06b4c6e4fe5dcaf2","entry":"RealNVP","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"06b4c6e4fe5dcaf2"}},{"code_sha256_prefix":"f0a2ff232a86d0e5","entry":"flow_kl_divergence","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0a2ff232a86d0e5"}},{"code_sha256_prefix":"f0e9e8de6e0e3d87","entry":"inverse_gaussian","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0e9e8de6e0e3d87"}},{"code_sha256_prefix":"0316dd20cd2470c9","entry":"mnistEncoder","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0316dd20cd2470c9"}},{"code_sha256_prefix":"527a7cf647e5e721","entry":"tabularEncoder","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"527a7cf647e5e721"}},{"code_sha256_prefix":"a9a5c6328685986d","entry":"CausalMultimodal","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a9a5c6328685986d"}},{"code_sha256_prefix":"ceafeef3c1f60c9b","entry":"mnistDecoder","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ceafeef3c1f60c9b"}},{"code_sha256_prefix":"6048b58f0ed1c614","entry":"tabularDecoder","repo":"lokali/PersonaX","repo_kind":"found_in_text","path":"2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","file_url":"https://github.com/lokali/PersonaX/blob/HEAD/2_synthetic_mnist_experiment/phenotype_3m_mnist/models/causalmultimodal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6048b58f0ed1c614"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}