IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2024)

Edge-Computing-Enabled Deep Learning Approach for Low-Light Satellite Image Enhancement

  • Trong-An Bui,
  • Pei-Jun Lee,
  • Chun-Sheng Liang,
  • Pei-Hsiang Hsu,
  • Shiuan-Hal Shiu,
  • Chen-Kai Tsai

DOI
https://doi.org/10.1109/JSTARS.2024.3357093
Journal volume & issue
Vol. 17
pp. 4071 – 4083

Abstract

Read online

Edge computing enables rapid data processing and decision-making on satellite payloads. Deploying deep learning-based techniques for low-light image enhancement improves early detection and tracking accuracy on satellite platforms, but it faces challenges due to limited computational resources. This article proposes an edge-computing-enabled inference model specifically designed onboard satellites. The proposed model follows an encoder–decoder architecture to generate the illumination map with low multiplication matrix complexity, 25.52 GMac of $1920 \times 1200$ image size. To reduce nanosatellite hardware consumption with a single-precision floating-point format, the edge-computing-enabled inference model proposes a quantized convolution that computes signed values. The proposed inference model is deployed on Arm Cortex-M3 microcontrollers onboard satellite payload (86.74 times faster than normal convolution model) but also has a similar quality with the low-light enhanced in full-precision computing of lightweight training model by using the peak signal-to-noise ratio (average of 28.94) and structural similarity index (average of 0.85) metrics.

Keywords