Information Fusion and Hand Alignment to Improve Hand Recognition in Forensic Scenarios

Abstract

In many forensic scenarios, criminals often attempt to conceal their identity by covering their face and other distinctive body parts. In such situations, physical evidence may, however, reveal other unique characteristics, e.g. hands, which can be used to identify offenders. In this context, several state-of-the-art biometric recognition systems have been proposed recently. These recognition systems offer high identification performance in restricted environments. However, in forensic scenarios, the environment is often unconstrained, making biometric identification considerably more difficult, with a consequent decrease in accuracy. In this article, we explore methods (e.g. hand alignment and information fusion) to improve the identification of subjects within forensic investigations. Experimental results show that explored techniques play an important role in the improvement of the identification performance of existing schemes: the combination of hand alignment and information fusion results in the highest Rank-1 identification performance improvement of up to 13.10% (i.e., 26.30% vs. 13.20%) and 16.30% (i.e., 77.00% vs. 60.70%) with respect to the baseline for the unconstrained databases NTU-PI_v1 and HaGRID, respectively (https://github.com/ljsoler/IF-HA-HandRecognition).

Keywords

• Hand recognition
• hand alignment
• information fusion
• forensic investigations
• uncontrolled scenarios