A Restoration Scheme for Spatial and Spectral Resolution of the Panchromatic Image Using the Convolutional Neural Network

Abstract

Remote sensing images are the product of information obtained by various sensors, and the higher the resolution of the image, the more information it contains. Therefore, improving the resolution of the remote sensing image is conducive to identify Earth resources from the remote sensing image. In this article, we present a multiple-branch panchromatic image resolution restoration network based on the convolutional neural network to improve the spatial and spectral resolution of the panchromatic image simultaneously, named MBPRR-Net. Specifically, we adopt a multibranch structure to extract abundant features and utilize a feature channel mixing block to enhance the interaction of adjacent channels between features. Feature aggregation in our method is used to learn more effective features from each branch, and then a cubic filter is utilized to enhance the aggregated features. After feature extraction, we use a recovery architecture to generate the final image. Moreover, we utilize image super-resolution to restore spatial resolution and image colorization to restore the spectral resolution so that we can compare it with some image colorization and super-resolution methods to verify the proposed method. Experiments show that the performance of our method is outstanding in terms of visual effects and objective evaluation metrics compared with some existing excellent image super-resolution and colorization methods.

Keywords

• Artificial neural network
• deep learning
• multispectral (MS) image
• panchromatic (PAN) image
• remote sensing image processing