MsWH: A Multi-Sensory Hardware Platform for Capturing and Analyzing Physiological Emotional Signals

Abstract

This paper presents a new physiological signal acquisition multi-sensory platform for emotion detection: Multi-sensor Wearable Headband (MsWH). The system is capable of recording and analyzing five different physiological signals: skin temperature, blood oxygen saturation, heart rate (and its variation), movement/position of the user (more specifically of his/her head) and electrodermal activity/bioimpedance. The measurement system is complemented by a porthole camera positioned in such a way that the viewing area remains constant. Thus, the user’s face will remain centered regardless of its position and movement, increasing the accuracy of facial expression recognition algorithms. This work specifies the technical characteristics of the developed device, paying special attention to both the hardware used (sensors, conditioning, microprocessors, connections) and the software, which is optimized for accurate and massive data acquisition. Although the information can be partially processed inside the device itself, the system is capable of sending information via Wi-Fi, with a very high data transfer rate, in case external processing is required. The most important features of the developed platform have been compared with those of a proven wearable device, namely the Empatica E4 wristband, in those measurements in which this is possible.

Keywords

• multi-sensory platform
• sensoring
• skin temperature
• blood oxygen saturation
• heart rate
• attitude and heading reference system