Artificial Intelligence of Behavior for Human Emotion Recognition in Closed Environments

Abstract

Understanding human emotions and behavior in closed environments is essential for creating more empathetic and humane spaces. Environmental factors, such as temperature, noise, and light, play a crucial role in influencing behavior, but individuals' emotional states are equally important and often go unnoticed. Artificial Intelligence of Behavior (AIoB) offers a novel approach that integrates environmental measurements with human emotions to create spatially adaptive processes that can influence behavior. In this article, we present a new human emotion sensor developed using video cameras and implemented on a System on Chip (SoC) development board. Our approach uses Convolutional Neural Networks (CNNs) to recognize the presence of emotions in enclosed spaces and generate parameters that can influence emotional states and behavior within an AIoB system. The research successfully integrates advanced CNN technology into a System on Chip (SoC) platform, allowing for real-time processing of video data. The versatility of utilizing an energy-efficient SoC extends its application to smart environments aimed at improving mental health. By employing algorithms capable of detecting emotional states across various individuals, the study enhances its effectiveness. Additionally, it identifies the best CNN operations tailored to the technical specifications of the devices involved. Thus, The development involves a three-step process: (i) collecting enough data to build a robust model, (ii) training the model and evaluating its performance using test values, and (iii) applying the model on the development board. Our study demonstrates the feasibility of using AIoB to recognize and respond to human emotions in closed areas. By integrating emotional cues with environmental measurements, our system can create more personalized and empathetic spaces that cater to the needs of individuals. Our approach could have significant implications for designing public spaces to promote well-being and emotional satisfaction.

Keywords

• Convolutional neural networks
• compressive sensing
• emotions
• image classification
• instrumentation
• system on chip