{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/inconsistent-dialogue-responses-and-how-to","title":"Inconsistent dialogue responses and how to recover from them","arxiv_id":"2401.10353","date":"2024-01-18","proceeding":null,"authors":["Mian Zhang","Lifeng Jin","Linfeng Song","Haitao Mi","Dong Yu"],"abstract":"One critical issue for chat systems is to stay consistent about preferences, opinions, beliefs and facts of itself, which has been shown a difficult problem. In this work, we study methods to assess and bolster utterance consistency of chat systems. A dataset is first developed for studying the inconsistencies, where inconsistent dialogue responses, explanations of the inconsistencies, and recovery utterances are authored by annotators. This covers the life span of inconsistencies, namely introduction, understanding, and resolution. Building on this, we introduce a set of tasks centered on dialogue consistency, specifically focused on its detection and resolution. Our experimental findings indicate that our dataset significantly helps the progress in identifying and resolving conversational inconsistencies, and current popular large language models like ChatGPT which are good at resolving inconsistencies however still struggle with detection.","url_abs":"https://arxiv.org/abs/2401.10353v1","url_pdf":"https://arxiv.org/pdf/2401.10353v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"inconsistent-dialogue-responses-and-how-to","repo_url":"https://github.com/mianzhang/cider","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2401.10353","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.10353"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mianzhang/cider","reach":{"status":"ok"}}],"summary":{"ran":6},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"7b91bbbc80876a25","entry":"combine_one_seq","repo":"mianzhang/cider","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7b91bbbc80876a25"}},{"code_sha256_prefix":"1863a6f51080495b","entry":"flat_array","repo":"mianzhang/cider","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1863a6f51080495b"}},{"code_sha256_prefix":"2728760bdc96e355","entry":"read_cdconv","repo":"mianzhang/cider","repo_kind":"official","path":"src/data_utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2728760bdc96e355"}},{"code_sha256_prefix":"0bc958a2294e3162","entry":"read_single_file","repo":"mianzhang/cider","repo_kind":"official","path":"src/data_utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0bc958a2294e3162"}},{"code_sha256_prefix":"32a50cf8331ae986","entry":"read_stance","repo":"mianzhang/cider","repo_kind":"official","path":"src/data_utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"32a50cf8331ae986"}},{"code_sha256_prefix":"ac28a2d89a01c888","entry":"tokenize","repo":"mianzhang/cider","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/mianzhang/cider/blob/HEAD/src/utils.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac28a2d89a01c888"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}