Animals (Jun 2024)

Application of Machine Learning for Automating Behavioral Tracking of Captive Bornean Orangutans (<i>Pongo Pygmaeus</i>)

  • Frej Gammelgård,
  • Jonas Nielsen,
  • Emilia J. Nielsen,
  • Malthe G. Hansen,
  • Aage K. Olsen Alstrup,
  • Juan O. Perea-García,
  • Trine H. Jensen,
  • Cino Pertoldi

DOI
https://doi.org/10.3390/ani14121729
Journal volume & issue
Vol. 14, no. 12
p. 1729

Abstract

Read online

This article applies object detection to CCTV video material to investigate the potential of using machine learning to automate behavior tracking. This study includes video tapings of two captive Bornean orangutans and their behavior. From a 2 min training video containing the selected behaviors, 334 images were extracted and labeled using Rectlabel. The labeled training material was used to construct an object detection model using Create ML. The use of object detection was shown to have potential for automating tracking, especially of locomotion, whilst filtering out false positives. Potential improvements regarding this tool are addressed, and future implementation should take these into consideration. These improvements include using adequately diverse training material and limiting iterations to avoid overfitting the model.

Keywords