IVML  
  about | r&d | publications | courses | people | links
   

S. Stylianou-Nikolaidou, I. Vernikos, E. Mathe, E. Spyrou, Ph. Mylonas
A Novel CNN-LSTM Hybrid Architecture for the Recognition of Human Activities
Proceedings of the International Neural Networks Society, Volume 3, Springer Nature, Switzerland
ABSTRACT
The problem of human activity recognition (HAR) has been increasingly attracting the efforts of the research community, having several applications. In this paper we propose a multi-modal approach addressing the task of video-based HAR. Our approach uses three modalities, i.e., raw RGB video data, depth sequences and 3D skeletal motion data. The latter are transformed into a 2D image representation into the spectral domain. In order to extract spatio-temporal features from the available data, we propose a novel hybrid deep neural network architecture that combines a Convolutional Neural Network (CNN) and a Long-Short Term Memory (LSTM) network. We focus on the tasks of recognition of activities of daily living (ADLs) and medical conditions and we evaluate our approach using two challenging datasets.
29 June , 2021
S. Stylianou-Nikolaidou, I. Vernikos, E. Mathe, E. Spyrou, Ph. Mylonas, "A Novel CNN-LSTM Hybrid Architecture for the Recognition of Human Activities", Proceedings of the International Neural Networks Society, Volume 3, Springer Nature, Switzerland
[ save PDF] [ BibTex] [ Print] [ Back]

© 00 The Image, Video and Multimedia Systems Laboratory - v1.12