Frontiers in Behavioral Neuroscience (Oct 2021)

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

  • Guanglong Sun,
  • Guanglong Sun,
  • Chenfei Lyu,
  • Chenfei Lyu,
  • Ruolan Cai,
  • Ruolan Cai,
  • Chencen Yu,
  • Chencen Yu,
  • Hao Sun,
  • Kenneth E. Schriver,
  • Kenneth E. Schriver,
  • Lixia Gao,
  • Lixia Gao,
  • Lixia Gao,
  • Xinjian Li,
  • Xinjian Li

DOI
https://doi.org/10.3389/fnbeh.2021.750894
Journal volume & issue
Vol. 15

Abstract

Read online

Behavioral measurement and evaluation are broadly used to understand brain functions in neuroscience, especially for investigations of movement disorders, social deficits, and mental diseases. Numerous commercial software and open-source programs have been developed for tracking the movement of laboratory animals, allowing animal behavior to be analyzed digitally. In vivo optical imaging and electrophysiological recording in freely behaving animals are now widely used to understand neural functions in circuits. However, it is always a challenge to accurately track the movement of an animal under certain complex conditions due to uneven environment illumination, variations in animal models, and interference from recording devices and experimenters. To overcome these challenges, we have developed a strategy to track the movement of an animal by combining a deep learning technique, the You Only Look Once (YOLO) algorithm, with a background subtraction algorithm, a method we label DeepBhvTracking. In our method, we first train the detector using manually labeled images and a pretrained deep-learning neural network combined with YOLO, then generate bounding boxes of the targets using the trained detector, and finally track the center of the targets by calculating their centroid in the bounding box using background subtraction. Using DeepBhvTracking, the movement of animals can be tracked accurately in complex environments and can be used in different behavior paradigms and for different animal models. Therefore, DeepBhvTracking can be broadly used in studies of neuroscience, medicine, and machine learning algorithms.

Keywords