Remote Sensing (Mar 2023)

Overcoming Domain Shift in Neural Networks for Accurate Plant Counting in Aerial Images

  • Javier Rodriguez-Vazquez,
  • Miguel Fernandez-Cortizas,
  • David Perez-Saura,
  • Martin Molina,
  • Pascual Campoy

DOI
https://doi.org/10.3390/rs15061700
Journal volume & issue
Vol. 15, no. 6
p. 1700

Abstract

Read online

This paper presents a novel semi-supervised approach for accurate counting and localization of tropical plants in aerial images that can work in new visual domains in which the available data are not labeled. Our approach uses deep learning and domain adaptation, designed to handle domain shifts between the training and test data, which is a common challenge in this agricultural applications. This method uses a source dataset with annotated plants and a target dataset without annotations and adapts a model trained on the source dataset to the target dataset using unsupervised domain alignment and pseudolabeling. The experimental results show the effectiveness of this approach for plant counting in aerial images of pineapples under significative domain shift, achieving a reduction up to 97% in the counting error (1.42 in absolute count) when compared to the supervised baseline (48.6 in absolute count).

Keywords