Nature Communications (Nov 2023)

A fully integrated, standalone stretchable device platform with in-sensor adaptive machine learning for rehabilitation

  • Hongcheng Xu,
  • Weihao Zheng,
  • Yang Zhang,
  • Daqing Zhao,
  • Lu Wang,
  • Yunlong Zhao,
  • Weidong Wang,
  • Yangbo Yuan,
  • Ji Zhang,
  • Zimin Huo,
  • Yuejiao Wang,
  • Ningjuan Zhao,
  • Yuxin Qin,
  • Ke Liu,
  • Ruida Xi,
  • Gang Chen,
  • Haiyan Zhang,
  • Chu Tang,
  • Junyu Yan,
  • Qi Ge,
  • Huanyu Cheng,
  • Yang Lu,
  • Libo Gao

DOI
https://doi.org/10.1038/s41467-023-43664-7
Journal volume & issue
Vol. 14, no. 1
pp. 1 – 14

Abstract

Read online

Abstract Post-surgical treatments of the human throat often require continuous monitoring of diverse vital and muscle activities. However, wireless, continuous monitoring and analysis of these activities directly from the throat skin have not been developed. Here, we report the design and validation of a fully integrated standalone stretchable device platform that provides wireless measurements and machine learning-based analysis of diverse vibrations and muscle electrical activities from the throat. We demonstrate that the modified composite hydrogel with low contact impedance and reduced adhesion provides high-quality long-term monitoring of local muscle electrical signals. We show that the integrated triaxial broad-band accelerometer also measures large body movements and subtle physiological activities/vibrations. We find that the combined data processed by a 2D-like sequential feature extractor with fully connected neurons facilitates the classification of various motion/speech features at a high accuracy of over 90%, which adapts to the data with noise from motion artifacts or the data from new human subjects. The resulting standalone stretchable device with wireless monitoring and machine learning-based processing capabilities paves the way to design and apply wearable skin-interfaced systems for the remote monitoring and treatment evaluation of various diseases.