Sensors (Sep 2022)

Fusion of Heterogenous Sensor Data in Border Surveillance

  • Luis Patino,
  • Michael Hubner,
  • Rachel King,
  • Martin Litzenberger,
  • Laure Roupioz,
  • Kacper Michon,
  • Łukasz Szklarski,
  • Julian Pegoraro,
  • Nikolai Stoianov,
  • James Ferryman

DOI
https://doi.org/10.3390/s22197351
Journal volume & issue
Vol. 22, no. 19
p. 7351

Abstract

Read online

Wide area surveillance has become of critical importance, particularly for border control between countries where vast forested land border areas are to be monitored. In this paper, we address the problem of the automatic detection of activity in forbidden areas, namely forested land border areas. In order to avoid false detections, often triggered in dense vegetation with single sensors such as radar, we present a multi sensor fusion and tracking system using passive infrared detectors in combination with automatic person detection from thermal and visual video camera images. The approach combines weighted maps with a rule engine that associates data from multiple weighted maps. The proposed approach is tested on real data collected by the EU FOLDOUT project in a location representative of a range of forested EU borders. The results show that the proposed approach can eliminate single sensor false detections and enhance accuracy by up to 50%.

Keywords