Artificial intelligence driven digital whole slide image for intelligent recognition of different development stages of tongue tumor via a new deep learning framework

Abstract

Abstract Accurate clinical diagnosis of the stage of tumor development is essential for formulating a treatment plan. However, the stage of tongue tumor development among malignant, benign and leukoplakia is easily misdiagnosed, resulting differing treatment approaches, taking patients in danger and preventing them from receiving the deserved care. This study aimed to establish an automatic recognition system for tongue tumors at different stages of development using artificial intelligence methods along with pathological tissue section images. By improving Swin Transformer framework, a new framework in deep learning, the tissue slice image is used to identify the lesion and non‐lesion areas by the patch‐based method, and then an output is reconstructed by self‐Assembly method that the lesion areas is marked with heat map. Subsequently, an automatic recognition system with a friendly page is designed for the stage of tongue tumor development (malignant, benign, and leukoplakia). The proposed model has a high recognition accuracy (98.45%). The prediction accuracy of each category of the system is higher than that of specialist doctors with 13 years of experience. The Swin Transformer framework was improved in this study to accurately and automatically identify the various stages of tongue tumor development.

Keywords

• artificial intelligence
• deep learning
• Swin Transformer
• tongue tumor