Kinetic Cross-Modal Correspondences and Felt (e)Motion in a Novel Set of Musical Stimuli

Abstract

Embodied music cognition predicts that our understanding of human-made sounds relates to our experience of making the same or similar movements and sounds, which involves imitation of the source of visual and auditory information. This embodiment of sound may lead to numerous kinetic cross-modal correspondences (CMCs). This article investigates music experience in participants with a non-professionally trained music background across three musical dimensions: Contour (Ascending, Descending, Flat), Vertical Density (Low, Medium, High), and Note Pattern (Binary, Ternary, Quaternary). In order that stimuli should reflect contemporary musical usage yet be subject to a high degree of experimental control, 27 ten-second digital piano tracks were created in collaboration with a film composer. In Study 1, participants were asked to rate the stimuli for perceived Direction, Rotation, Movement, and Emotional and Physical Involvement. We test the effects of these factors in terms of the following theories: general and vocal embodied responses to music, the Ecological Theory of Rotating Sounds, and the Shared Affective Motion Experience model of emotion induction. Results for Study 1 were consistent with theories of general and vocal embodied responses to music, as well as with theories of embodied emotional contagion in music. Study 1 also revealed potential confounds in the stimuli, which were further investigated in Study 2 with a new set of participants rating the stimuli for perceived Pitch, Loudness, and Speed. Results for Study 2 served to dissociate intrinsic features of the stimuli from CMCs. Taken together, the two studies reveal a range of embodied CMCs. Although there are limitations to a perceptual study such as this, these stimuli stand to benefit future research in further investigating the embodiment of musical motion.