Scientific Reports (Jul 2024)

Combined MediaPipe and YOLOv5 range of motion assessment system for spinal diseases and frozen shoulder

  • Weijia Zhang,
  • Yulin Li,
  • Shaomin Cai,
  • Zhaowei Wang,
  • Xue Cheng,
  • Nutapong Somjit,
  • Dongqing Sun,
  • Feiyu Chen

DOI
https://doi.org/10.1038/s41598-024-66221-8
Journal volume & issue
Vol. 14, no. 1
pp. 1 – 14

Abstract

Read online

Abstract Spinal diseases and frozen shoulder are prevalent health problems in Asian populations. Early assessment and treatment are very important to prevent the disease from getting worse and reduce pain. In the field of computer vision, it is a challenging problem to assess the range of motion. In order to realize efficient, real-time and accurate assessment of the range of motion, an assessment system combining MediaPipe and YOLOv5 technologies was proposed in this study. On this basis, Convolutional Block Attention Module (CBAM) is introduced into the YOLOv5 target detection model, which can enhance the extraction of feature information, suppress background interference, and improve the generalization ability of the model. In order to meet the requirements of large-scale computing, a client/server (C/S) framework structure is adopted. The evaluation results can be obtained quickly after the client uploads the image data, providing a convenient and practical solution. In addition, a game of "Picking Bayberries" was developed as an auxiliary treatment method to provide patients with interesting rehabilitation training.

Keywords