WiFi-Based Human Sensing With Deep Learning: Recent Advances, Challenges, and Opportunities

Abstract

The rapid advancements in wireless technologies have led to numerous research studies that provide evidence of the successful utilization of wireless signals, particularly, WiFi signals for human activity sensing in the indoor environment. As a promising technology, WiFi-based human sensing can be utilized for a variety of applications such as smart healthcare, smart homes, security, industry, office indoor environments etc., due to the availability of rich infrastructure. Furthermore, compared to other radio frequency (RF) based systems such as radio detection and ranging (RADAR) and radio frequency identification (RFID), WiFi is non-invasive, has low-cost, and provides ubiquitous coverage in the indoor setup. However, due to the limited accuracy and high complexity of the model-based approaches for human sensing, the systems empowered by the deep learning (DL) techniques have achieved remarkable performance gains and showed more robustness in dealing with complicated human sensing tasks. The article explores the physical layer parameters used in WiFi sensing such as received signal strength indicator (RSSI) and channel state information (CSI), the estimated parameters such as angle-of-arrival (AoA) and Doppler shift (DS) along with frequency modulated continuous wave (FMCW) RADAR technology. Moreover, the preliminary signal processing stages that are applied to the received WiFi signals in the DL assisted systems are discussed. This article provides a comprehensive literature survey on the recent advances in DL-empowered WiFi sensing focusing on human activity recognition and movement tracking followed by fall detection, single task-multi task classification, crowd monitoring and sensing, indoor localization, gaits recognition, and pose estimation. Furthermore, the paper highlight the challenges in the existing literature and discusses the possible future research directions in WiFi-based human sensing assisted by DL techniques.

Keywords

• Deep learning
• device-based sensing
• device-free sensing
• human activity recognition
• human pose estimation
• indoor localization