Intelligent Service for Hybrid Analysis of Continuous Mental Processes Based on EEG and Video Data

Abstract

In the paper we present our developed service for analyzing the continuous mental processes of the human brain. We developed the service to support electroencephalogram data analysis specialist. The service allows to implement a hybrid analysis of continuous processes using electroencephalogram and video recording data. Electroencephalogram data analysis is performed on the basis of static and dynamic signal characteristics in different frequency ranges. The video is analyzed using the models developed earlier by the authors, which allow tracking such physiological parameters as respiration rate, blood pressure, heart rate, blood oxygen saturation, and different motion parameters of human body & head. Hybrid analysis of these two data sources allows for partial automation of signal filtering, speeds up electroencephalogram analysis by a specialist, and training automatic models for recognizing continuous mental processes. Our service provides a practical implementation of such hybrid analysis using a set of signal processing modules adaptable to the needs of the study. The article describes the functionality of individual modules of the service and provides some practical examples of their use in analyzing the meditation process.

Keywords

• hybrid eeg analysis
• continuous mental processes
• spectral eeg analysis