Papers › Motion Fused Frames: Data Level Fusion Strategy for Hand Gesture Recognition
Motion Fused Frames: Data Level Fusion Strategy for Hand Gesture Recognition
Okan Köpüklü, Neslihan Köse, Gerhard Rigoll
Acquiring spatio-temporal states of an action is the most crucial step for action classification. In this paper, we propose a data level fusion strategy, Motion Fused Frames (MFFs), designed to fuse motion information into static images as better representatives of spatio-temporal states of an action. MFFs can be used as input to any deep learning architecture with very little modification on the network. We evaluate MFFs on hand gesture recognition tasks using three video datasets - Jester, ChaLearn LAP IsoGD and NVIDIA Dynamic Hand Gesture Datasets - which require capturing long-term temporal relations of hand movements. Our approach obtains very competitive performance on Jester and ChaLearn benchmarks with the classification accuracies of 96.28% and 57.4%, respectively, while achieving state-of-the-art performance with 84.7% accuracy on NVIDIA benchmark.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Hand Gesture Recognition | ChaLean test | 8-MFFs-3f1c | Accuracy | 56.7 | #1 of 1 | Archive leaderboard | report |
| Hand Gesture Recognition | ChaLearn val | 8-MFFs-3f1c (5 crop) | Accuracy | 57.4 | #1 of 3 | Archive leaderboard | report |
| Hand Gesture Recognition | Jester test | DRX3D | Top 1 Accuracy | 96.6 | #1 of 2 | Archive leaderboard | report |
| Hand Gesture Recognition | Jester val | 8-MFFs-3f1c (5 crop) | Top 1 Accuracy | 96.33 | #1 of 1 | Archive leaderboard | report |
| Hand Gesture Recognition | Jester val | 8-MFFs-3f1c (5 crop) | Top 5 Accuracy | 99.86 | #1 of 1 | Archive leaderboard | report |
| Hand Gesture Recognition | NVGesture | 8-MFFs-3f1c | Accuracy | 84.7 | #5 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections