Identification of Large Yellow Croaker under Variable Conditions Based on the Cycle Generative Adversarial Network and Transfer Learning

Abstract

Variable-condition fish recognition is a type of cross-scene and cross-camera fish re-identification (re-ID) technology. Due to the difference in the domain distribution of fish images collected under different culture conditions, the available training data cannot be effectively used for the new identification method. To solve these problems, we proposed a new method for identifying large yellow croaker based on the CycleGAN (cycle generative adversarial network) and transfer learning. This method constructs source sample sets and target sample sets by acquiring large yellow croaker images in controllable scenes and actual farming conditions, respectively. The CycleGAN was used as the basic framework for image transformation from the source domain to the target domain to realize data amplification in the target domain. In particular, IDF (identity foreground loss) was used to optimize identity loss judgment criteria, and MMD (maximum mean discrepancy) was used to narrow the distribution between the source domain and target domain. Finally, transfer learning was carried out with the expanded samples to realize the identification of large yellow croaker under varying conditions. The experimental results showed that the proposed method achieved good identification results in both the controlled scene and the actual culture scene, with an average recognition accuracy of 96.9% and 94%, respectively. These provide effective technical support for the next steps in fish behavior tracking and phenotype measurement.

Keywords

• fish recognition
• CycleGAN
• foreground mask loss
• maximum mean discrepancy
• transfer learning