Fusion of Multi-Intensity Image for Deep Learning-Based Human and Face Detection

Abstract

For ordinary IR-illuminators in nighttime surveillance system, insufficient illumination may cause misdetection for faraway object while excessive illumination leads to over-exposure of nearby object. To overcome these two problems, we use the MI3 image dataset, which is established by multi-intensity IR-illumination (MIIR), as our benchmark dataset for modern object detection methods. We first provide complete annotations for the MI3 as its current ground-truth is incomplete. Then, we use these multi-intensity illuminated IR videos to evaluate several widely used object detectors, i.e., SSD, YOLO, Faster R-CNN, and Mask R-CNN, by analyzing the effective range of different illumination intensities. By including a tracking scheme, as well as developing of a new fusion method for different illumination intensities to improve the performance, the proposed approach may serve as a new benchmark of face and object detection for a wide range of distances. The new dataset (Dataset is available: https://ieee-dataport.org/documents/mi3) with more complete annotations and source codes (Codes are available: https://github.com/thesuperorange/deepMI3) is available online.

Keywords

• Object detection
• nighttime surveillance
• face tracking
• multi-intensity IR illuminator