Research on Arthroscopic Images Bleeding Detection Algorithm Based on ViT-ResNet50 Integrated Model and Transfer Learning

Abstract

Arthroscopic surgery is a major technique for the treatment of joint-related diseases, however, intraoperative bleeding often produces a blood mist that severely affects the surgeon’s field of vision and requires prompt high-flow drainage to remove the mist. Therefore, accurate bleeding detection is a prerequisite for effective blood mist removal. This paper proposes an arthroscopic image bleeding detection method based on the ViT-ResNet50 integrated model and transfer learning to solve the problem of relying on naked eye to identify bleeding in existing arthroscopic surgery. Firstly, Vision Transformer model and ResNet50 model are used to learn features by transfer learning on ImageNet dataset respectively. Then, a difference-enhanced proportional sampling method is proposed to enhance the unbalanced data. Finally, the two sub-network models are integrated through weighted soft voting method to realize bleeding detection in arthroscopic images. In order to evaluate the performance of the model proposed in this paper, experimental results on real data show that the integrated model is superior to a single deep learning model in various performance indicators and has good effects in detecting bleeding in arthroscopic images.

Keywords

• Arthroscopy surgery
• bleeding detection
• transfer learning
• integrated model
• Vision Transformer
• ResNet50