Incorporating Multi-Temporal Remote Sensing and a Pixel-Based Deep Learning Classification Algorithm to Map Multiple-Crop Cultivated Areas

Abstract

The accurate monitoring of crop areas is essential for food security and agriculture, but accurately extracting multiple-crop distribution over large areas remains challenging. To solve the above issue, in this study, the Pixel-based One-dimensional convolutional neural network (PB-Conv1D) and Pixel-based Bi-directional Long Short-Term Memory (PB-BiLSTM) were proposed to identify multiple-crop cultivated areas using time-series NaE (a combination of NDVI and EVI) as input for generating a baseline classification. Two approaches, Snapshot and Stochastic weighted averaging (SWA), were used in the base-model to minimize the loss function and improve model accuracy. Using an ensemble algorithm consisting of five PB-Conv1D and seven PB-BiLSTM models, the temporal vegetation index information in the base-model was comprehensively exploited for multiple-crop classification and produced the Pixel-Based Conv1D and BiLSTM Ensemble model (PB-CB), and this was compared with the PB-Transformer model to validate the effectiveness of the proposed method. The multiple-crop cultivated area was extracted from 2005, 2010, 2015, and 2020 in North China by using the PB-Conv1D combine Snapshot (PB-CDST) and PB-CB models, which are a performance-optimized single model and an integrated model, respectively. The results showed that the mapping results of the multiple-crop cultivated area derived by PB-CDST (OA: 81.36%) and PB-BiLSTM combined with Snapshot (PB-BMST) (OA: 79.40%) showed exceptional accuracy compared to PB-Transformer combined with Snapshot and SWA (PB-TRSTSA) (OA: 77.91%). Meanwhile, the PB-CB (OA: 83.43%) had the most accuracy compared to the pixel-based single algorithm. The MODIS-derived PB-CB method accurately identified multiple-crop areas for wheat, corn, and rice, showing a strong correlation with statistical data, exceeding 0.7 at the municipal level and 0.6 at the county level.

Keywords

• multiple-crop classification
• multi-temporal data
• deep learning
• remote sensing
• snapshot
• SWA