Sensors (Mar 2023)

Spatially Offset Raman Spectroscopy Combined with Attention-Based LSTM for Freshness Evaluation of Shrimp

  • Zhenfang Liu,
  • Yu Yang,
  • Min Huang,
  • Qibing Zhu

DOI
https://doi.org/10.3390/s23052827
Journal volume & issue
Vol. 23, no. 5
p. 2827

Abstract

Read online

Optical detection of the freshness of intact in-shell shrimps is a well-known difficult task due to shell occlusion and its signal interference. The spatially offset Raman spectroscopy (SORS) is a workable technical solution for identifying and extracting subsurface shrimp meat information by collecting Raman scattering images at different distances from the offset laser incidence point. However, the SORS technology still suffers from physical information loss, difficulties in determining the optimum offset distance, and human operational errors. Thus, this paper presents a shrimp freshness detection method using spatially offset Raman spectroscopy combined with a targeted attention-based long short-term memory network (attention-based LSTM). The proposed attention-based LSTM model uses the LSTM module to extract physical and chemical composition information of tissue, weight the output of each module by an attention mechanism, and come together as a fully connected (FC) module for feature fusion and storage dates prediction. Modeling predictions by collecting Raman scattering images of 100 shrimps within 7 days. The R2, RMSE, and RPD of the attention-based LSTM model achieved 0.93, 0.48, and 4.06, respectively, which is superior to the conventional machine learning algorithm with manual selection of the optimal spatially offset distance. This method of automatically extracting information from SORS data by Attention-based LSTM eliminates human error and enables fast and non-destructive quality inspection of in-shell shrimp.

Keywords