{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/pre-trained-and-attention-based-neural","title":"Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems","arxiv_id":"2004.01940","date":"2020-04-04","proceeding":null,"authors":["Jia-Chen Gu","Tianda Li","Quan Liu","Xiaodan Zhu","Zhen-Hua Ling","Yu-Ping Ruan"],"abstract":"The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Technology Challenges (DSTC 8), is the extension of DSTC 7. This track incorporates new elements that are vital for the creation of a deployed task-oriented dialogue system. This paper describes our systems that are evaluated on all subtasks under this challenge. We study the problem of employing pre-trained attention-based network for multi-turn dialogue systems. Meanwhile, several adaptation methods are proposed to adapt the pre-trained language models for multi-turn dialogue systems, in order to keep the intrinsic property of dialogue systems. In the released evaluation results of Track 2 of DSTC 8, our proposed models ranked fourth in subtask 1, third in subtask 2, and first in subtask 3 and subtask 4 respectively.","url_abs":"https://arxiv.org/abs/2004.01940v1","url_pdf":"https://arxiv.org/pdf/2004.01940v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"conversation-disentanglement","task_name":"Conversation Disentanglement"},{"task_slug":"task-oriented-dialogue-systems","task_name":"Task-Oriented Dialogue Systems"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/conversation-disentanglement-on-irc","task":"Conversation Disentanglement","dataset":"irc-disentanglement","model":"BERT + BiLSTM","rank_in_archive_order":1,"of":5,"metrics":{"F":"46.8","P":"44.3","R":"49.6","VI":"93.3"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.01940","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}