A Novel Smartphone-Based Human Activity Recognition Approach using Convolutional Autoencoder Long Short-Term Memory Network

Dipanwita Thakur, Sandip Roy, Suparna Biswas, Edmond S. L. Ho, Samiran Chattopadhyay, Sachin Shetty

Abstract: In smart and intelligent health care, smartphone sensor-based automatic recognition of human activities has evolved as an emerging field of research. In many application domains, deep learning (DL) strategies are more effective than conventional machine learning (ML) models, and human activity recognition (HAR) is no exception. In this paper, we propose a novel framework (CAEL-HAR), that combines CNN, Autoencoder and LSTM architectures for efficient smartphone-based HAR operation. There is a natural synergy between the modeling abilities of LSTMs, autoencoders, and CNNs. While AEs are used for dimensionality reduction and CNNs are the best at automating feature extraction, LSTMs excel at modeling time series. Taking advantage of their complementarity, the proposed methodology combines CNNs, AEs, and LSTMs into a single architecture. We evaluated the proposed architecture using the UCI, WISDM public benchmark datasets. The simulation and experimental results certify the merits of the proposed method and indicate that it outperforms computing time, F1-score, precision, accuracy, and recall in comparison to the current state-of-the-art methods.