GGLA-NeXtE2NET: A Dual-Branch Ensemble Network With Gated Global-Local Attention for Enhanced Brain Tumor Recognition

Abstract

Due to the limited availability of training data, the diverse shapes of brain tumors among different patients, inter-class similarity, and intra-class variation, achieving high recognition accuracy and speed in deep learning-based brain tumor recognition remains challenging. To address these issues, we propose a Dual-Branch Ensemble and Gated Global-Local Attention network based on EfficientNetV2S and ConvNeXt (GGLA-NeXtE2NET) to improve identification accuracy and model interpretability. For inter-class and intra-class problems, we designed a Gated Global-Local Attention (GGLA) mechanism that captures dependency information of query points in both horizontal and vertical directions, thereby obtaining global information indirectly. Simultaneously, local information is captured through multiple convolutions with a gating layer. The gating mechanism within the GGLA dynamically balances the contributions of global and local information, enabling the model to adaptively focus on the most relevant features for accurate classification. Furthermore, we introduce a dual-branch ensemble network to address the issue of image variety. This network uses two branches to extract image features at different resolutions for fusion, thereby expanding the network receptive field. Additionally, we utilized an Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) to generate images that balance MRI data and implemented multiple preprocessing techniques to tackle inherent noise in MRI images. These techniques enhance the clarity of MRI images while preserving essential details. This results in a clear improvement in the identification of tumor boundaries, crucial for accurate surgical planning and treatment strategies. We evaluated GGLA-NeXtE2NET on 3-class and 4-class brain tumor datasets and achieved 99.06%, and 99.62% overall accuracy on both datasets respectively.

Keywords

• MRI brain tumor
• deep learning
• image processing
• medical image analysis
• attention mechanism