{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/window-transformer-for-dialogue-document-a","title":"Window transformer for dialogue document: a joint framework for causal emotion entailment","arxiv_id":null,"date":"2023-02-24","proceeding":"International Journal of Machine Learning and Cybernetics 2023 2","authors":["Dazhi Jiang","Hao liu","Geng Tu & Runguo Wei"],"abstract":"The Causal Emotion Entailment (CEE) task aims to extract all potential pairs of emotions and corresponding causes from the unannotated emotion document in the conversational context. Most existing methods to solve CEE task follow a two-stage pipeline framework, in which the first stage is to identify emotional clauses and cause clauses and extract clause representation,separately. And in the second stage is to construct the final emotion and cause pairs. However, they ignore the effect of the distance between clauses on emotion-cause pair matching. Here, we construct a joint framework with Window Transformer to handle this problem. The pre-trained BERT and RoBERTa are used as the text encoder to generate a local representation of clauses in a given document. Meanwhile, we feed it into 2D Window Transformer to make the clause representation sensitive to the context within the Window and to obtain the dependencies between clauses. At the same time, the document ranks the candidate clauses to extract causal emotion entailments, which enhances the representation of clause pairs (emotion pairs and cause pairs) by kernel-based relative position embedding. Experimental results indicate that the framework acquires state-of-the-art results on the benchmark dataset.","url_abs":"https://link.springer.com/article/10.1007/s13042-023-01792-y","url_pdf":"https://link.springer.com/article/10.1007/s13042-023-01792-y","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"causal-emotion-entailment","task_name":"Causal Emotion Entailment"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"roberta","method_name":"RoBERTa"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/causal-emotion-entailment-on-reccon","task":"Causal Emotion Entailment","dataset":"RECCON","model":"Window transformer","rank_in_archive_order":3,"of":9,"metrics":{"Macro F1":"80.53","Neg. F1":"97.69","Pos. F1":"63.10"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}