{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dial2vec-self-guided-contrastive-learning-of","title":"Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings","arxiv_id":"2210.15332","date":"2022-10-27","proceeding":null,"authors":["Che Liu","Rui Wang","Junfeng Jiang","Yongbin Li","Fei Huang"],"abstract":"In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models (PLMs) have been shown to be feasible for this task. However, these approaches typically ignore the conversational interactions between interlocutors, resulting in poor performance. To address this issue, we proposed a self-guided contrastive learning approach named dial2vec. Dial2vec considers a dialogue as an information exchange process. It captures the conversational interaction patterns between interlocutors and leverages them to guide the learning of the embeddings corresponding to each interlocutor. The dialogue embedding is obtained by an aggregation of the embeddings from all interlocutors. To verify our approach, we establish a comprehensive benchmark consisting of six widely-used dialogue datasets. We consider three evaluation tasks: domain categorization, semantic relatedness, and dialogue retrieval. Dial2vec achieves on average 8.7, 9.0, and 13.8 points absolute improvements in terms of purity, Spearman's correlation, and mean average precision (MAP) over the strongest baseline on the three tasks respectively. Further analysis shows that dial2vec obtains informative and discriminative embeddings for both interlocutors under the guidance of the conversational interactions and achieves the best performance when aggregating them through the interlocutor-level pooling strategy. All codes and data are publicly available at https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/dial2vec.","url_abs":"https://arxiv.org/abs/2210.15332v1","url_pdf":"https://arxiv.org/pdf/2210.15332v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dial2vec-self-guided-contrastive-learning-of","repo_url":"https://github.com/alibabaresearch/damo-convai","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sentence-embeddings","task_name":"Sentence Embeddings"}],"methods":[{"method_slug":"contrastive-learning","method_name":"Contrastive Learning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.15332","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.15332"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/AlibabaResearch/DAMO-ConvAI","reach":null}],"summary":{"ran":7,"unverified":4},"by_repo_kind":{"official":{"samples":11,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fa58498fdf4cb81e","entry":"BERTAttention","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa58498fdf4cb81e"}},{"code_sha256_prefix":"fb68baf229e1cf5a","entry":"BERTEmbeddings","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb68baf229e1cf5a"}},{"code_sha256_prefix":"c45a021ae43f1086","entry":"BERTIntermediate","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c45a021ae43f1086"}},{"code_sha256_prefix":"ddd04d6d8b2852c9","entry":"BERTPooler","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ddd04d6d8b2852c9"}},{"code_sha256_prefix":"a5e5c3ae263c81ac","entry":"BERTSelfAttention","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5e5c3ae263c81ac"}},{"code_sha256_prefix":"6c50f0691f85142a","entry":"BERTavg","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c50f0691f85142a"}},{"code_sha256_prefix":"e64c9e8361c93aaa","entry":"BertConfig","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e64c9e8361c93aaa"}},{"code_sha256_prefix":"2297486f7089cbcd","entry":"BERTEncoder","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2297486f7089cbcd"}},{"code_sha256_prefix":"f3faae060e87ee86","entry":"BERTLayer","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f3faae060e87ee86"}},{"code_sha256_prefix":"a7725d578d6fc49c","entry":"BertModel","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7725d578d6fc49c"}},{"code_sha256_prefix":"da1e6c7924893059","entry":"Dial2vec","repo":"AlibabaResearch/DAMO-ConvAI","repo_kind":"official","path":"dial2vec/modeling_bert.py","file_url":"https://github.com/AlibabaResearch/DAMO-ConvAI/blob/HEAD/dial2vec/modeling_bert.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da1e6c7924893059"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}