A Fundamental Study on Influence of Concurrently Presented Visual Stimulus Upon Loudness Perception

Abstract

As a basic study on the influence of the dynamic properties of the audio-visual stimuli upon interaction between audition and vision, the effect of the simple movement involved in the visual stimulus on the loudness perception of the audio stimulus was investigated via psychophysical experiment. In this experiment, the visual stimulus given to subjects along with the audio stimulus is a bar appeared on a display, one side of which is flexibly expanding and contracting. The loudness of the audio stimulus with such a visual effect concurrently presented was rated as an absolute numerical value by using the Magnitude Estimation method. The reference of the bar length is determined so as to correspond to the Zwicker's loudness calculated for the given audio stimulus. As a result, the visual stimulus did not affect the loudness perception, when the bar was presented with its length same as the reference. On the other hand, the rating of the loudness for the same audio stimulus was significantly increased when the bar length was longer than the reference. This indicates that the change in the correspondence between the audio and the visual stimuli affect the loudness perception.