{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/livechat-a-large-scale-personalized-dialogue","title":"LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming","arxiv_id":"2306.08401","date":"2023-06-14","proceeding":null,"authors":["Jingsheng Gao","Yixin Lian","Ziyi Zhou","Yuzhuo Fu","Baoyuan Wang"],"abstract":"Open-domain dialogue systems have made promising progress in recent years. While the state-of-the-art dialogue agents are built upon large-scale text-based social media data and large pre-trained models, there is no guarantee these agents could also perform well in fast-growing scenarios, such as live streaming, due to the bounded transferability of pre-trained models and biased distributions of public datasets from Reddit and Weibo, etc. To improve the essential capability of responding and establish a benchmark in the live open-domain scenario, we introduce the LiveChat dataset, composed of 1.33 million real-life Chinese dialogues with almost 3800 average sessions across 351 personas and fine-grained profiles for each persona. LiveChat is automatically constructed by processing numerous live videos on the Internet and naturally falls within the scope of multi-party conversations, where the issues of Who says What to Whom should be considered. Therefore, we target two critical tasks of response modeling and addressee recognition and propose retrieval-based baselines grounded on advanced techniques. Experimental results have validated the positive effects of leveraging persona profiles and larger average sessions per persona. In addition, we also benchmark the transferability of advanced generation-based models on LiveChat and pose some future directions for current challenges.","url_abs":"https://arxiv.org/abs/2306.08401v1","url_pdf":"https://arxiv.org/pdf/2306.08401v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"livechat-a-large-scale-personalized-dialogue","repo_url":"https://github.com/gaojingsheng/livechat","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.08401","atlas_url":"https://app.syntology.ai/?focus=2306.08401","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.08401"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gaojingsheng/livechat","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":9},"by_repo_kind":{"official":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"64043631a96154a1","entry":"DotProDuctLoss","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/AddresseeRecognition/src/train_cobert.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/AddresseeRecognition/src/train_cobert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64043631a96154a1"}},{"code_sha256_prefix":"31be6bb24d20e77b","entry":"cal_bleu","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/Generation/src/metrics.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/Generation/src/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"31be6bb24d20e77b"}},{"code_sha256_prefix":"8fa104a47ef1735e","entry":"cal_dist","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/Generation/src/metrics.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/Generation/src/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8fa104a47ef1735e"}},{"code_sha256_prefix":"284d95b45459530e","entry":"load_pk","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/AddresseeRecognition/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/AddresseeRecognition/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"284d95b45459530e"}},{"code_sha256_prefix":"75b1a1a5b32c73df","entry":"load_pk","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/Generation/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/Generation/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75b1a1a5b32c73df"}},{"code_sha256_prefix":"7f85ab5b93172770","entry":"load_pk_persona","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/AddresseeRecognition/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/AddresseeRecognition/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f85ab5b93172770"}},{"code_sha256_prefix":"385d4f88a19adf9f","entry":"load_retrive_history_post","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/AddresseeRecognition/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/AddresseeRecognition/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"385d4f88a19adf9f"}},{"code_sha256_prefix":"c6948dc7082d01c7","entry":"postprocess_text","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/Generation/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/Generation/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6948dc7082d01c7"}},{"code_sha256_prefix":"f385c3302abe91e0","entry":"process_index_to_str","repo":"gaojingsheng/livechat","repo_kind":"official","path":"Tasks/ResponseModeling/src/utils.py","file_url":"https://github.com/gaojingsheng/livechat/blob/HEAD/Tasks/ResponseModeling/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f385c3302abe91e0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}