Speckle Noise Reduction for Medical Ultrasound Images Using Hybrid CNN-Transformer Network

Abstract

Ultrasound images are often affected by limited resolution, artifacts, and inherent speckle noise. To address these challenges, researchers have explored denoising approaches. Recently, deep learning methods have demonstrated distinct advantages in ultrasound image denoising. However, further improvements are needed to preserve structural details, such as boundaries, edges, and margins. This paper proposes a hybrid CNN-transformer network called HCTSpeckle, an encoder-decoder network with a fusion block designed to enhance ultrasound images. The fusion block combines swin transformers to capture global modeling relationships, and convolutional neural networks to extract local modeling details. It is integrated into the encoder-decoder structure, allowing the model to focus on both local and global texture structural information. An improved swin block is also introduced into the network to improve robustness by extracting more significant features. HCTSpeckle was evaluated both quantitatively and qualitatively with clinical objectives using two public and two private datasets. Both results showed that HCTSpeckle significantly enhanced the ultrasound image quality and outperformed state-of-the-art methods in noise reduction and structure preservation across all four datasets. Compared to existing denoising methods, HCTSpeckle achieved notably faster performance in terms of complexity comparison, such as parameter counts, gigaFLOPs, and inference time. Moreover, this study assessed the effectiveness of HCTSpeckle for alveolar bone segmentation using dental images, demonstrating that HCTSpeckle significantly improved segmentation performance. Furthermore, an experienced radiologist blindly rated the 250 dental US images on a scale of 1 to 5, with 5 being the highest image quality, showing that HCTSpeckle consistently produced higher-quality images.

Keywords

• Convolutional neural network
• deep learning
• hybrid network
• image denoising
• intraoral ultrasound
• speckle noise