IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2024)

<inline-formula><tex-math notation="LaTeX">$C^{2}N^{2}$</tex-math></inline-formula>: Complex-Valued Contourlet Neural Network

  • Mengkun Liu,
  • Licheng Jiao,
  • Xu Liu,
  • Lingling Li,
  • Fang Liu,
  • Shuyuan Yang,
  • Yuwei Guo,
  • Puhua Chen

DOI
https://doi.org/10.1109/JSTARS.2024.3358846
Journal volume & issue
Vol. 17
pp. 4478 – 4491

Abstract

Read online

Complex-valued convolutional neural networks (CV-CNN) have recently gained recognition in feature representation learning. It implements the repeated application of the operations in convolution, local average pooling, and the absolute value of the resulting vectors. However, it is only conducted in the complex spatial domain, and lacks effective representation of directionality, singularity, and regularity in the complex spectral domain for anomaly detection of images. This is the key to feature learning representation of high-order singularity. To solve this problem, a complex-valued contourlet neural network (C$^{2}$N$^{2}$) is proposed in this article. It is novel in this sense that, different from the CV-CNN in the spatial domain, the spectral stream of C$^{2}$N$^{2}$ can enhance the multiresolution sparse representation of nonsubsampled contourlet (NSCT) with multiscales and multidirections for images. Furthermore, the spectral feature integration module is proposed to capture the statistical properties of the NSCT coefficients. It is shown that the proposed network can improve the distinguishability of feature learning and classification ability in theoretical analysis and experiments on three benchmark datasets (Flevoland, Xi'an, and Germany) compared with developed methods. Polarimetric synthetic aperture radar image classification is widely used in the fields of agriculture, forestry, and military. It must be emphasized that there is potential in effective feature learning representation and the generalization capability of C$^{2}$N$^{2}$ in deep learning, recognition, and interpretation.

Keywords