A Multimodal Model of ECG and Heart Sound Signal by Considering Normal and Abnormal Heart

Abstract

Analysis of the opening and closing of heart valves and the movement of blood flow in the heart are important in the domain of early detection of heart conditions. To build this correlation model, multimodal signals from electrocardiography and stethoscope are needed. Multimodal signaling was performed using primary data with the same sampling at 10 seconds by recording the PQRST heart signal in the lying position using electrocardiography and the heart sound in the sitting position using an electronic stethoscope. Experimental results showed that the number of R peaks is the same as the number of S1 sound peaks, and also the number of T peaks with the number of S2 sound peaks, so it can be concluded that there is a regular signal pattern relationship between S1-S2 and the RT wave, namely the relationship at the end of the first peak of the QRS wave. The cardiac signal due to ventricular depolarization (ventricular contraction), the appearance of an S1 heart sound, and the association of the end of the next peak of the T wave of cardiac signals indicate ventricular repolarization and the appearance of an S2 heart sound. This is consistent with the fact that electrical events in cardiac activity occur before mechanical events in normal heart conditions. Based on the study of HRV parameters, heart sound signals can be used to determine HRV parameters. The results show the same number of peaks in normal hearts, while in abnormal hearts, there are differences in results because abnormal heart conditions have an erratic rhythmic pattern.

Keywords

• multimodal signal
• heart sound
• ecg signal
• hrv.