Peanut Defect Identification Based on Multispectral Image and Deep Learning
Yang Wang,
Zhao Ding,
Jiayong Song,
Zhizhu Ge,
Ziqing Deng,
Zijie Liu,
Jihong Wang,
Lifeng Bian,
Chen Yang
Affiliations
Yang Wang
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Zhao Ding
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Jiayong Song
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Zhizhu Ge
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Ziqing Deng
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Zijie Liu
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Jihong Wang
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
Lifeng Bian
Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
Chen Yang
Semiconductor Power Device Reliability Engineering Research Center, Ministry of Education, College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, China
To achieve the non-destructive detection of peanut defects, a multi-target identification method based on the multispectral system and improved Faster RCNN is proposed in this paper. In terms of the system, the root-mean-square contrast method was employed to select the characteristic wavelengths for defects, such as mildew spots, mechanical damage, and the germ of peanuts. Then, a multispectral light source system based on a symmetric integrating sphere was designed with 2% nonuniformity illumination. In terms of Faster RCNN improvement, a texture-based attention and a feature enhancement module were designed to enhance the performance of its backbone. In the experiments, a peanut-deficient multispectral dataset with 1300 sets was collected to verify the detection performance. The results show that the evaluation metrics of all improved compared with the original network, especially in the VGG16 backbone network, where the mean average precision (mAP) reached 99.97%. In addition, the ablation experiments also verify the effectiveness of the proposed texture module and texture enhancement module in peanut defects detection. In conclusion, texture imaging enhancement and efficient extraction are effective methods to improve the network performance for multi-target peanut defect detection.