Dynamic Convolution Neural Networks with Both Global and Local Attention for Image Classification

Abstract

Convolution is a crucial component of convolution neural networks (CNNs). However, the standard static convolution has two primary defects: data independence and the weak ability to integrate global and local features. This paper proposes a novel and efficient dynamic convolution method with global and local attention to address these issues. A building block called the Global and Local Attention Unit (GLAU) is designed, in which a weighted fusion of global channel attention kernels and local spatial attention kernels generates the proposed dynamic convolution kernels. The GLAU is data-dependent and has better adaptability and the ability to integrate global and local features into each layer. We refer to such modified CNNs with GLAUs as “GLAUNets”. Extensive evaluation experiments for image classification compared to classical CNNs and the state-of-the-art dynamic convolution neural networks were conducted on the popular benchmark datasets. In terms of classification accuracy, the number of parameters, and computational complexity, the experimental results demonstrate the outstanding performance of GLAUNets.

Keywords

• attention mechanism
• convolution neural network
• dynamic kernel
• image classification