Methods › GER
Gait Emotion Recognition
GER
Introduced by Uttaran Bhattacharya et al. in STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
We present a novel classifier network called STEP, to classify perceived human emotion from gaits, based on a Spatial Temporal Graph Convolutional Network (ST-GCN) architecture. Given an RGB video of an individual walking, our formulation implicitly exploits the gait features to classify the perceived emotion of the human into one of four emotions: happy, sad, angry, or neutral. We train STEP on annotated real-world gait videos, augmented with annotated synthetic gaits generated using a novel generative network called STEP-Gen, built on an ST-GCN based Conditional Variational Autoencoder (CVAE). We incorporate a novel push-pull regularization loss in the CVAE formulation of STEP-Gen to generate realistic gaits and improve the classification accuracy of STEP. We also release a novel dataset (E-Gait), which consists of 4,227 human gaits annotated with perceived emotions along with thousands of synthetic gaits. In practice, STEP can learn the affective features and exhibits classification accuracy of 88\% on E-Gait, which is 14--30\% more accurate over prior methods.
Papers archive 2025-07-28
18 shown of 18, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context 23 May 2025 · 1 repository · arXiv:2505.17410
-
Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech Recognition 3 Jan 2025 · 1 repository · arXiv:2501.04038
-
Benchmarking Japanese Speech Recognition on ASR-LLM Setups with Multi-Pass Augmented Generative Error Correction 29 Aug 2024 · 0 repositories · arXiv:2408.16180
-
A Survey of Deep Learning for Group-level Emotion Recognition 13 Aug 2024 · 0 repositories · arXiv:2408.15276
-
A Discrete Perspective Towards the Construction of Sparse Probabilistic Boolean Networks 16 Jul 2024 · 1 repository · arXiv:2407.11543
-
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models 16 May 2024 · 0 repositories · arXiv:2405.10025
-
MMGER: Multi-modal and Multi-granularity Generative Error Correction with LLM for Joint Accent and Speech Recognition 6 May 2024 · 0 repositories · arXiv:2405.03152
-
A Generative Approach for Wikipedia-Scale Visual Entity Recognition 4 Mar 2024 · 2 repositories · arXiv:2403.02041
-
It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech Recognition 8 Feb 2024 · 1 repository · arXiv:2402.05457Syntology ran 2 of 6 samples · 4 unverified
-
Large Language Models are Efficient Learners of Noise-Robust Speech Recognition 19 Jan 2024 · 1 repository · arXiv:2401.10446Syntology ran 1 of 1 samples · 0 unverified
-
GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognition 7 Dec 2023 · 1 repository · arXiv:2312.04293Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
Generative error correction for code-switching speech recognition using large language models 17 Oct 2023 · 0 repositories · arXiv:2310.13013
-
Towards A Robust Group-level Emotion Recognition via Uncertainty-Aware Learning 6 Oct 2023 · 0 repositories · arXiv:2310.04306
-
Design and Planning of Flexible Mobile Micro-Grids Using Deep Reinforcement Learning 8 Dec 2022 · 0 repositories · arXiv:2212.04136
-
Modeling Fine-grained Information via Knowledge-aware Hierarchical Graph for Zero-shot Entity Retrieval 20 Nov 2022 · 1 repository · arXiv:2211.10991
-
Distributed Privacy-Preserving Electric Vehicle Charging Control Based on Secret Sharing 5 Oct 2021 · 0 repositories · arXiv:2110.02280
-
Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-Informed Deep Generative Models 5 Aug 2020 · 0 repositories · arXiv:2008.01915
-
STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits 28 Oct 2019 · 1 repository · arXiv:1910.12906
Tasks archive 2025-07-28
20 shown of 41 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
The archive places this method in no collection.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections