Evaluation and Improvement of Generalization Performance of SAR Ship Recognition Algorithms

Abstract

As artificial intelligence continues to advance, deep learning has greatly contributed to the advancement of ship recognition using synthetic aperture radar (SAR) images. Deep learning-based SAR ship recognition performance is largely dependent on the sample set used. SAR ship recognition datasets published in recent years, however, are most derived from a single SAR satellite sensor. It needs to be evaluated and analyzed carefully whether the model trained by a single satellite dataset can still achieve the same accuracy with different SAR satellites. This article focuses on the following research to address these issues. First, using multiple SAR satellite sensors, we create a new SAR ship dataset (named generalization performance evaluation dataset, GPED) containing multiresolution and multipolarization data to examine the generalization performance of the deep learning-based SAR ship recognition method. GPED and a marine target detection dataset (MTDD) are then used to evaluate and analyze the generalization performance of current mainstream deep learning methods. According to the the experiment results, the mean average accuracy of the ship recognition model trained on GPED is generally higher than that of MTDD, which proves that the GPED has a better generalization performance. Furthermore, SAR ship detection datasets have more samples than ship recognition datasets, which inspired us to use transfer learning to transfer knowledge from ship detection to ship recognition. In this article, a method for ship recognition based on transfer learning that utilizes the knowledge gained from the ship detection task is proposed. The method includes two modules: 1) pretraining module and 2) fine-tuning module. It can apply samples of unlabeled ship types to ship recognition, thus reducing the number of labeled samples that are required for ship recognition. The experimental results on GPED and MTDD show that our method can achieve good recognition performances.

Keywords

• Deep learning
• generalization performance
• ship recognition
• synthetic aperature radar (SAR)
• transfer learning