IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2024)

Toward Accurate Infrared Small Target Detection via Edge-Aware Gated Transformer

  • Yiming Zhu,
  • Yong Ma,
  • Fan Fan,
  • Jun Huang,
  • Kangle Wu,
  • Ge Wang

DOI
https://doi.org/10.1109/JSTARS.2024.3386899
Journal volume & issue
Vol. 17
pp. 8779 – 8793

Abstract

Read online

Extracting small targets from complex backgrounds is the eventual goal of single-frame infrared small target detection, which has many potential applications in defense security and marine rescue. Recently, methods utilizing deep learning have shown their superiority over traditional theoretical approaches. However, they do not consider both the global semantics and specific shape information, thereby limiting their performance. To overcome this proplem, we propose a gated-shaped TransUnet (GSTUnet), designed to fully utilize shape information while detecting small target detection. Specifically, we have proposed a multiscale encoder branch to extract global features of small targets at different scales. Then, the extracted global features are passed through a gated-shaped stream branch that focuses on the shape information of small targets through gate convolutions. Finally, we fuse their features to obtain the final result. Our GSTUnet learns both global and shape information through the aforementioned two branches, establishing global relationships between different feature scales. The GSTUnet demonstrates excellent evaluation metrics on various datasets, outperforming current state-of-the-art methods.

Keywords