{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-27805","title":"ChildEval: When large language models meet children's personalities","arxiv_id":"2605.27805","date":"2026-05-27","proceeding":null,"authors":["Yanyan Luo","Xue Han","Chunxu Zhao","Ruiqiao Bai","Yaxing Zhang","Qian Hu","Lijun Mei","Junlan Feng"],"abstract":"While LLMs enable personalized chatbots, their effectiveness in child-centered personalization remains unclear, as systematic evaluation of child-specific preferences is still lacking. To address this gap, we introduce ChildEval, a benchmark for evaluating LLMs' ability to infer and follow child-centered preferences in long-context conversations. ChildEval contains 29K synthesized persona profiles of children aged 3-6, providing relatively static background information. Each persona is associated with a child preference-which may align with, conflict with, or be independent of the persona-expressed either explicitly in a single sentence or implicitly through 6-10 turn dialogues. Explicit and implicit preferences are designed to reflect the same underlying preference but differ in expression, capturing dynamic aspects of preference expression rather than changes in the static persona. The benchmark spans five top-level and fourteen sub-level categories covering children's daily lives and development. We further propose fine-grained, child-centric evaluation protocols to systematically assess open-source LLMs. Experimental results demonstrate how different personalized representations affect LLM responses and suggest that finetuning on ChildEval can enhance child-centered performance. Our code and dataset are available at https://github.com/ziyanluo/ChildEval.","url_abs":"https://arxiv.org/abs/2605.27805","url_pdf":"https://arxiv.org/pdf/2605.27805","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.27805"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ziyanluo/ChildEval","reach":null}],"summary":{"ran":3,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"a80afec879a476bb","entry":"load_evaluation_data","repo":"ziyanluo/ChildEval","repo_kind":"found_in_text","path":"evaluation_scripts/extract_preferenc_accuracy.py","file_url":"https://github.com/ziyanluo/ChildEval/blob/HEAD/evaluation_scripts/extract_preferenc_accuracy.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a80afec879a476bb"}},{"code_sha256_prefix":"38c31bf4b4395f5e","entry":"parse_preference_and_question","repo":"ziyanluo/ChildEval","repo_kind":"found_in_text","path":"generate_implict_persona_dialog.py","file_url":"https://github.com/ziyanluo/ChildEval/blob/HEAD/generate_implict_persona_dialog.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"38c31bf4b4395f5e"}},{"code_sha256_prefix":"1e922028e3fcabd6","entry":"parse_prompt","repo":"ziyanluo/ChildEval","repo_kind":"found_in_text","path":"evaluation_scripts/evaluate_accuracy_name.py","file_url":"https://github.com/ziyanluo/ChildEval/blob/HEAD/evaluation_scripts/evaluate_accuracy_name.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1e922028e3fcabd6"}},{"code_sha256_prefix":"10e51ba66f51ddaf","entry":"analyze_errors","repo":"ziyanluo/ChildEval","repo_kind":"found_in_text","path":"evaluation_scripts/extract_preferenc_accuracy.py","file_url":"https://github.com/ziyanluo/ChildEval/blob/HEAD/evaluation_scripts/extract_preferenc_accuracy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"10e51ba66f51ddaf"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}