Papers › NAC-TCN: Temporal Convolutional Networks with Causal Dilated Neighborhood Attention...

NAC-TCN: Temporal Convolutional Networks with Causal Dilated Neighborhood Attention for Emotion Understanding

12 Dec 2023arXiv:2312.07507archive 2025-07-28

Alexander Mehta, William Yang

In the task of emotion recognition from videos, a key improvement has been to focus on emotions over time rather than a single frame. There are many architectures to address this task such as GRUs, LSTMs, Self-Attention, Transformers, and Temporal Convolutional Networks (TCNs). However, these methods suffer from high memory usage, large amounts of operations, or poor gradients. We propose a method known as Neighborhood Attention with Convolutions TCN (NAC-TCN) which incorporates the benefits of attention and Temporal Convolutional Networks while ensuring that causal relationships are understood which results in a reduction in computation and memory cost. We accomplish this by introducing a causal version of Dilated Neighborhood Attention while incorporating it with convolutions. Our model achieves comparable, better, or state-of-the-art performance over TCNs, TCAN, LSTMs, and GRUs while requiring fewer parameters on standard emotion recognition datasets. We publish our code online for easy reproducibility and use in other projects.

PaperPDFCode

Code

alexmehta/nac-tcn-tcns-with-causal-na officialmentioned in paperpytorchGPL-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Emotion Recognition

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

FocusNeighborhood Attention

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections