Papers › Window transformer for dialogue document: a joint framework for causal emotion entailment

Window transformer for dialogue document: a joint framework for causal emotion entailment

24 Feb 2023International Journal of Machine Learning and Cybernetics 2023 2archive 2025-07-28

Dazhi Jiang, Hao liu, Geng Tu & Runguo Wei

The Causal Emotion Entailment (CEE) task aims to extract all potential pairs of emotions and corresponding causes from the unannotated emotion document in the conversational context. Most existing methods to solve CEE task follow a two-stage pipeline framework, in which the first stage is to identify emotional clauses and cause clauses and extract clause representation,separately. And in the second stage is to construct the final emotion and cause pairs. However, they ignore the effect of the distance between clauses on emotion-cause pair matching. Here, we construct a joint framework with Window Transformer to handle this problem. The pre-trained BERT and RoBERTa are used as the text encoder to generate a local representation of clauses in a given document. Meanwhile, we feed it into 2D Window Transformer to make the clause representation sensitive to the context within the Window and to obtain the dependencies between clauses. At the same time, the document ranks the candidate clauses to extract causal emotion entailments, which enhances the representation of clause pairs (emotion pairs and cause pairs) by kernel-based relative position embedding. Experimental results indicate that the framework acquires state-of-the-art results on the benchmark dataset.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Causal Emotion Entailment

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Causal Emotion Entailment RECCON Window transformer Macro F1 80.53 #3 of 9 Archive leaderboard report
Causal Emotion Entailment RECCON Window transformer Neg. F1 97.69 #3 of 9 Archive leaderboard report
Causal Emotion Entailment RECCON Window transformer Pos. F1 63.10 #3 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionAttention DropoutBERTBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionRoBERTaSoftmaxTransformerWeight DecayWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections