{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-neural-model-for-dialogue-coherence","title":"Dialogue Coherence Assessment Without Explicit Dialogue Act Labels","arxiv_id":"1908.08486","date":"2019-08-22","proceeding":"ACL 2020 6","authors":["Mohsen Mesgar","Sebastian Bücker","Iryna Gurevych"],"abstract":"Recent dialogue coherence models use the coherence features designed for monologue texts, e.g. nominal entities, to represent utterances and then explicitly augment them with dialogue-relevant features, e.g., dialogue act labels. It indicates two drawbacks, (a) semantics of utterances is limited to entity mentions, and (b) the performance of coherence models strongly relies on the quality of the input dialogue act labels. We address these issues by introducing a novel approach to dialogue coherence assessment. We use dialogue act prediction as an auxiliary task in a multi-task learning scenario to obtain informative utterance representations for coherence assessment. Our approach alleviates the need for explicit dialogue act labels during evaluation. The results of our experiments show that our model substantially (more than 20 accuracy points) outperforms its strong competitors on the DailyDialogue corpus, and performs on par with them on the SwitchBoard corpus for ranking dialogues concerning their coherence.","url_abs":"https://arxiv.org/abs/1908.08486v2","url_pdf":"https://arxiv.org/pdf/1908.08486v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-neural-model-for-dialogue-coherence","repo_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"multi-task-learning","task_name":"Multi-Task Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1908.08486","atlas_url":"https://app.syntology.ai/?focus=1908.08486","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.08486"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"dff9f48cecc8d74e","entry":"da_filter_zero","repo":"UKPLab/acl2020-dialogue-coherence-assessment","repo_kind":"official","path":"mtl_coherency.py","file_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment/blob/HEAD/mtl_coherency.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dff9f48cecc8d74e"}},{"code_sha256_prefix":"246e3f4787793288","entry":"draw_rand_sent","repo":"UKPLab/acl2020-dialogue-coherence-assessment","repo_kind":"official","path":"create_coherency_dataset.py","file_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment/blob/HEAD/create_coherency_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"246e3f4787793288"}},{"code_sha256_prefix":"658bd4ace7fb97bd","entry":"draw_rand_sent_from_df","repo":"UKPLab/acl2020-dialogue-coherence-assessment","repo_kind":"official","path":"create_coherency_dataset.py","file_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment/blob/HEAD/create_coherency_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"658bd4ace7fb97bd"}},{"code_sha256_prefix":"85647999e99ebb92","entry":"get_batches","repo":"UKPLab/acl2020-dialogue-coherence-assessment","repo_kind":"official","path":"data_preparation.py","file_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment/blob/HEAD/data_preparation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"85647999e99ebb92"}},{"code_sha256_prefix":"78064a7b80034401","entry":"permute","repo":"UKPLab/acl2020-dialogue-coherence-assessment","repo_kind":"official","path":"create_coherency_dataset.py","file_url":"https://github.com/UKPLab/acl2020-dialogue-coherence-assessment/blob/HEAD/create_coherency_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"78064a7b80034401"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}