Emotional State Prediction From Online Handwriting and Signature Biometrics

Abstract

Handwriting and signature biometrics have a long history in the literature, especially in terms of identity recognition and/or verification; nevertheless, it reveals more information therefore provides more opportunities for personal characteristics estimation, particularly, emotional state. However, almost all publicly or commercially available databases do not include contributors' demographic labels or emotional status in addition to their identification labels, leading these available databases to be only useful for verification and identification based research studies. For this reason, this paper proposes both offline and online handwriting and signature biometric database with a wide range of ground truths (emotional status labels - happy, sad and stress) in addition to the identity labels and tries to predict ones' emotional state, namely happy, sad and stress, from their online biometric handwriting and signatures. The proposed database comprised total of 134 participants with 804 handwriting and 8040 signature biometric samples. The database presented also includes individuals' demographic information such as age, gender, handedness, education level and nationality. Subsequently, there are several experiments have been conducted, with different thresholds, which present the usability of the proposed database and preliminary results of emotional state prediction from both signature and handwriting biometrics. The experiments achieved remarkable success especially on stress prediction for handwriting. On the other hand, considering the results from signature biometrics, it is observed that happy and then sad and finally stress class forms the most part of the prediction accuracy.

Keywords

• Soft-biometrics
• handwriting biometrics
• signature biometrics
• biometric database
• emotion prediction