Remote Sensing (Sep 2021)

Glassboxing Deep Learning to Enhance Aircraft Detection from SAR Imagery

  • Ru Luo,
  • Jin Xing,
  • Lifu Chen,
  • Zhouhao Pan,
  • Xingmin Cai,
  • Zengqi Li,
  • Jielan Wang,
  • Alistair Ford

DOI
https://doi.org/10.3390/rs13183650
Journal volume & issue
Vol. 13, no. 18
p. 3650

Abstract

Read online

Although deep learning has achieved great success in aircraft detection from SAR imagery, its blackbox behavior has been criticized for low comprehensibility and interpretability. Such challenges have impeded the trustworthiness and wide application of deep learning techniques in SAR image analytics. In this paper, we propose an innovative eXplainable Artificial Intelligence (XAI) framework to glassbox deep neural networks (DNN) by using aircraft detection as a case study. This framework is composed of three parts: hybrid global attribution mapping (HGAM) for backbone network selection, path aggregation network (PANet), and class-specific confidence scores mapping (CCSM) for visualization of the detector. HGAM integrates the local and global XAI techniques to evaluate the effectiveness of DNN feature extraction; PANet provides advanced feature fusion to generate multi-scale prediction feature maps; while CCSM relies on visualization methods to examine the detection performance with given DNN and input SAR images. This framework can select the optimal backbone DNN for aircraft detection and map the detection performance for better understanding of the DNN. We verify its effectiveness with experiments using Gaofen-3 imagery. Our XAI framework offers an explainable approach to design, develop, and deploy DNN for SAR image analytics.

Keywords