{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-02754","title":"$Ψ$-Bench: Evaluating Persona-Sensitive Influencing in Persuasive Dialogues","arxiv_id":"2606.02754","date":"2026-06-01","proceeding":null,"authors":["Peixuan Han","Hongyi Du","Jiayu Liu","Yihang Sun","Yutong Liu","Jiaxuan You"],"abstract":"Personalization is a crucial capability of modern language agents. However, current research primarily positions personalized agents as passive responders to user preferences, limiting their ability to interact with users and provide suggestions or guidance proactively. To systematically evaluate such proactive personalization in realistic interactions, we propose $Ψ$-Bench, a benchmark for assessing LLMs' ability to influence realistic users through conversation. We design three real-world interaction scenarios that involve persuasion in $Ψ$-Bench, and endow simulated clients with personal characteristics through explicit user profiles derived from dialogue histories. We evaluate 10 frontier LLMs on $Ψ$-Bench and find that while most models can produce coherent and reasonable arguments, even state-of-the-art models still leave considerable room for improvement in persuasion. We also find that providing access to client profiles yields an average performance gain of 18.24\\%, highlighting the importance of user-specific information for effective persuasion. Overall, our work highlights persona-sensitive influencing as a challenging yet practical direction for evaluating and developing more proactive personalized LLM agents. Codes are available at: https://github.com/Hanpx20/Psi-Bench.","url_abs":"https://arxiv.org/abs/2606.02754","url_pdf":"https://arxiv.org/pdf/2606.02754","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.02754","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.02754"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Hanpx20/Psi-Bench","reach":null}],"summary":{"ran":7,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"84326e9327196024","entry":"collect_all_scores","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/llm_judge_eval.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/llm_judge_eval.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"84326e9327196024"}},{"code_sha256_prefix":"6048d0bbfbc046be","entry":"collect_scores_from_response","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/llm_judge_eval.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/llm_judge_eval.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6048d0bbfbc046be"}},{"code_sha256_prefix":"e507a30d12534318","entry":"download_file","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/download_data.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/download_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e507a30d12534318"}},{"code_sha256_prefix":"a3962b73083333bd","entry":"download_from_github","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/download_data.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/download_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a3962b73083333bd"}},{"code_sha256_prefix":"0d4084f14f39b5d9","entry":"extract_archive","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/download_data.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/download_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d4084f14f39b5d9"}},{"code_sha256_prefix":"eb8197586c3241b7","entry":"fill_persona_template","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/utils.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"eb8197586c3241b7"}},{"code_sha256_prefix":"0364a0562736ff44","entry":"init_stats_dict","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/llm_judge_eval.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/llm_judge_eval.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0364a0562736ff44"}},{"code_sha256_prefix":"7a13711f2e280400","entry":"gen_client_prompt","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/utils.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7a13711f2e280400"}},{"code_sha256_prefix":"4f6fe8c5cefde8de","entry":"gen_persuader_prompt","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/utils.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f6fe8c5cefde8de"}},{"code_sha256_prefix":"048adfe60fe298d4","entry":"process_persuader_response","repo":"Hanpx20/Psi-Bench","repo_kind":"found_in_text","path":"psi_bench/inference.py","file_url":"https://github.com/Hanpx20/Psi-Bench/blob/HEAD/psi_bench/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"048adfe60fe298d4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}