IEEE Access (Jan 2022)

Activities Recognition, Anomaly Detection and Next Activity Prediction Based on Neural Networks in Smart Homes

  • Khaled A. Alaghbari,
  • Mohamad Hanif Md. Saad,
  • Aini Hussain,
  • Muhammad Raisul Alam

DOI
https://doi.org/10.1109/ACCESS.2022.3157726
Journal volume & issue
Vol. 10
pp. 28219 – 28232

Abstract

Read online

In this paper, we propose a unified deep learning model for monitoring elderly in execution of daily life activities such as eating, sleeping or taking medication. The proposed approach consists of three stages which are activity recognition, anomaly detection and next activity prediction. Such a system can provide useful information for the elderly, caregivers and medical teams to identify activities and generate preventive and corrective measures. In literature, these stages are discussed separately, however, in our approach, we make use of each stage to progress into the next stage. At first, activity recognition based on different extracted features is performed using a deep neural network (DNN), then an overcomplete-deep autoencoder (OCD-AE) is employed to separate the normal from anomalous activities. Finally, a cleaned sequence of consecutive activities is constructed and used by a long short-term memory (LSTM) algorithm to predict the next activity. Since the last two stages depend on the activity recognition stage, we propose to increase its accuracy by exploiting different extracted features. The performance of the proposed unified approach has been evaluated on real smart home datasets to demonstrate its ability to recognize activities, detect anomalies and predict the next activity.

Keywords