IEEE Access (Jan 2024)

IoST-Enabled Robotic Arm Control and Abnormality Prediction Using Minimal Flex Sensors and Gaussian Mixture Models

  • Tajim Md. Niamat Ullah Akhund,
  • Zaffar Ahmed Shaikh,
  • Isabel De La Torre Diez,
  • Manal Gafar,
  • Deep H. Ajabani,
  • Osama Alfarraj,
  • Amr Tolba,
  • Henry Fabian-Gongora,
  • Luis Alonso Dzul Lopez

DOI
https://doi.org/10.1109/ACCESS.2024.3380360
Journal volume & issue
Vol. 12
pp. 45265 – 45278

Abstract

Read online

This work presents a groundbreaking approach with a fusion of the Internet of Sensing Things (IoST) and Robotics. This system utilizes four flex sensors strategically placed on the most flexible fingers across both hands to control a Six-DoF robotic arm, offering a novel interface for those with limited mobility. This system can also be used for moving toxic objects. The Raspberry Pi is the central control unit that acquires data from the flex sensors and controls the servo motors. Moreover, the device incorporates machine learning to learn the daily movements of the users and predict abnormal finger movements. Multiple data analyses and visualizations are initiated to predict the normal and abnormal data. GMMs or Gaussian Mixture Models showed successful results among various abnormality detection processes. This amalgamation of flexible sensing and mathematical modeling offers precision and adaptability in control mechanisms.

Keywords