{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-pre-training-based-personalized-dialogue","title":"A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data","arxiv_id":"1911.04700","date":"2019-11-12","proceeding":null,"authors":["Yinhe Zheng","Rongsheng Zhang","Xiaoxi Mao","Minlie Huang"],"abstract":"Endowing dialogue systems with personas is essential to deliver more human-like conversations. However, this problem is still far from well explored due to the difficulties of both embodying personalities in natural languages and the persona sparsity issue observed in most dialogue corpora. This paper proposes a pre-training based personalized dialogue model that can generate coherent responses using persona-sparse dialogue data. In this method, a pre-trained language model is used to initialize an encoder and decoder, and personal attribute embeddings are devised to model richer dialogue contexts by encoding speakers' personas together with dialogue histories. Further, to incorporate the target persona in the decoding process and to balance its contribution, an attention routing structure is devised in the decoder to merge features extracted from the target persona and dialogue contexts using dynamically predicted weights. Our model can utilize persona-sparse dialogues in a unified manner during the training process, and can also control the amount of persona-related features to exhibit during the inference process. Both automatic and manual evaluation demonstrates that the proposed model outperforms state-of-the-art methods for generating more coherent and persona consistent responses with persona-sparse data.","url_abs":"https://arxiv.org/abs/1911.04700v1","url_pdf":"https://arxiv.org/pdf/1911.04700v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-pre-training-based-personalized-dialogue","repo_url":"https://github.com/Lireanstar/BPDG","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"a-pre-training-based-personalized-dialogue","repo_url":"https://github.com/ghosthamlet/persona","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"dialogue-generation","task_name":"Dialogue Generation"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1911.04700","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.04700"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Lireanstar/BPDG","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ghosthamlet/persona","reach":null}],"summary":{"ran":1,"ran_honours":1,"unverified":10},"by_repo_kind":{"listed":{"samples":12,"ran":2,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"630cad41c958eab5","entry":"count_ngram","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_distinct.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_distinct.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"630cad41c958eab5"}},{"code_sha256_prefix":"74ee173b5a288642","entry":"epoch_time","repo":"ghosthamlet/persona","repo_kind":"listed","path":"AttentionRouting/trainer.py","file_url":"https://github.com/ghosthamlet/persona/blob/HEAD/AttentionRouting/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"74ee173b5a288642"}},{"code_sha256_prefix":"c3f6270b38a24112","entry":"convert2str_biased","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"generate_for_different_weight.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/generate_for_different_weight.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c3f6270b38a24112"}},{"code_sha256_prefix":"a9175f4c15228f9e","entry":"convert2str_biased","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"generate_our_sample.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/generate_our_sample.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9175f4c15228f9e"}},{"code_sha256_prefix":"265176bed2384a33","entry":"convert2str_random","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"generate_for_different_weight.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/generate_for_different_weight.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"265176bed2384a33"}},{"code_sha256_prefix":"2dc8a8ca058b4e62","entry":"convert2str_random","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"generate_our_sample.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/generate_our_sample.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2dc8a8ca058b4e62"}},{"code_sha256_prefix":"d80bae86a71b0be8","entry":"corpus_bleu","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_bleu.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_bleu.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d80bae86a71b0be8"}},{"code_sha256_prefix":"4a9c412680bac6ee","entry":"eval_distinct","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_distinct.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_distinct.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4a9c412680bac6ee"}},{"code_sha256_prefix":"1ec2c2d36a3cda9a","entry":"eval_ppl","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_ppl.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_ppl.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ec2c2d36a3cda9a"}},{"code_sha256_prefix":"d52e5869b9bdda18","entry":"modified_precision","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_bleu.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_bleu.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d52e5869b9bdda18"}},{"code_sha256_prefix":"82c47c8c6308eca1","entry":"pad_sequence","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_bleu.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_bleu.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82c47c8c6308eca1"}},{"code_sha256_prefix":"b8f38ce75cf35fdb","entry":"read_dialog","repo":"Lireanstar/BPDG","repo_kind":"listed","path":"eval_distinct.py","file_url":"https://github.com/Lireanstar/BPDG/blob/HEAD/eval_distinct.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8f38ce75cf35fdb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}