Browse State-of-the-Art › Multimodal Activity Recognition
Multimodal Activity Recognition
12 papers with code · 10 benchmarks · 6 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
10 leaderboard tables shown for this task, 10 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
6 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 30 · with a code link: 12 · where Syntology ran a sample: 2 (2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 30 tagged: 2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 30 of 30, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
23 Jan 2018 24 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Dynamics of human body skeletons convey significant information for human action recognition.
-
2 Aug 2016 22 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified (of 24 harvested samples) · 3 pointer-only (licence)The other contribution is our study on a series of good practices in learning ConvNets on video data with the help of temporal segment network.
-
9 Jan 2018 4 repositories listedWe present the Moments in Time Dataset, a large-scale human-annotated collection of one million short videos corresponding to dynamic events unfolding within three seconds.
-
13 Mar 2020 2 repositories listedWe present a simple, yet effective and flexible method for action recognition supporting multiple sensor modalities.
-
30 May 2019 2 repositories listedLearning to represent videos is a very challenging task both algorithmically and computationally.
-
8 Oct 2021 1 repository listedThis dataset can be exploited to advance WiFi and vision-based HAR, for example, using pattern recognition, skeletal representation, deep learning algorithms or other novel approaches to accurately recognize human…
-
27 Sep 2021 1 repository listedIn this paper, we present Fusion-GCN, an approach for multimodal action recognition using Graph Convolutional Networks (GCNs).
-
22 Apr 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)Having access to multi-modal cues (e. g. vision and audio) empowers some cognitive tasks to be done faster compared to learning from a single modality.
-
1 Jun 2019 1 repository listedHuman action recognition remains as a challenging task partially due to the presence of large variations in the execution of action.
-
20 Apr 2019 1 repository listedTo make up this, we introduce a new, large-scale EV-Action dataset in this work, which consists of RGB, depth, electromyography (EMG), and two skeleton modalities.
-
1 Jan 2019 1 repository listedWe report state-of-the-art or comparable results on video action recognition on the largest multimodal dataset available for this task, the NTU RGB+D, as well as on the UWA3DII and Northwestern-UCLA.
-
14 Apr 2017 1 repository listedIn this work, we propose to use a new class of models known as Temporal Convolutional Neural Networks (TCN) for 3D human action recognition.
-
22 Feb 2022 0 repositories listedMultimodal sensors (visual, non-visual, and wearable) can provide complementary information to develop robust perception systems for recognizing activities accurately.
-
1 Apr 2021 0 repositories listedRecognizing human activities is one of the crucial capabilities that a robot needs to have to be useful around people.
-
1 Oct 2019 0 repositories listedUnlike vision modalities, body-worn sensors or passive sensing can avoid the failure of action understanding in vision related challenges, e.g. occlusion and appearance variation.
-
13 Sep 2019 0 repositories listedFor the Nurse Care Activity Recognition Challenge, an activity recognition algorithm was developed by Team TDU-DSML.
-
9 Sep 2019 0 repositories listedFor the last two decades, more and more complex methods have been developed to identify human activities using various types of sensors, e.g., data from motion capture, accelerometer, and gyroscopes sensors.
-
Nurse care activity recognition challenge: summary and results9 Sep 2019 0 repositories listedAlthough activity recognition has been studied for a long time now, research and applications have focused on physical activity recognition.
-
28 May 2019 0 repositories listedThere has been significant amount of research work on human activity classification relying either on Inertial Measurement Unit (IMU) data or data from static cameras providing a third-person view.
-
26 Feb 2019 0 repositories listedWhile depth cameras and inertial sensors have been frequently leveraged for human action recognition, these sensing modalities are impractical in many scenarios where cost or environmental constraints prohibit their use.
-
9 Jan 2019 0 repositories listedHuman Activity Recognition (HAR) is a key building block of many emerging applications such as intelligent mobility, sports analytics, ambient-assisted living and human-robot interaction.
-
14 Dec 2018 0 repositories listedExisting methods in video action recognition mostly do not distinguish human body from the environment and easily overfit the scenes and objects.
-
Uncertainty aware audiovisual activity recognition using deep Bayesian variational inference27 Nov 2018 0 repositories listedDeep neural networks (DNNs) provide state-of-the-art results for a multitude of applications, but the approaches using DNNs for multimodal audiovisual applications do not consider predictive uncertainty associated with…
-
1 Jun 2018 0 repositories listedMost video-based action recognition approaches choose to extract features from the whole video to recognize actions.
-
23 Mar 2016 0 repositories listedSingle modality action recognition on RGB or depth sequences has been extensively explored recently.
-
7 Dec 2015 0 repositories listedGiven a video or time series of skeleton data, action recognition systems perform classification using cues such as motion, appearance, and pose.
-
1 Nov 2015 0 repositories listedThis paper proposes a new method, i.e., weighted hierarchical depth motion maps (WHDMM) + three-channel deep convolutional neural networks (3ConvNets), for human action recognition from depth maps on small training…
-
31 Jul 2015 0 repositories listedThe articulated and complex nature of human actions makes the task of action recognition difficult.
-
1 May 2015 0 repositories listedHuman action recognition is a very active research topic in computer vision and pattern recognition.
-
3 Mar 2014 0 repositories listedHuman action recognition based on the depth information provided by commodity depth sensors is an important yet challenging task.
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections