Multisensory Illusions and the Temporal Binding Window

Abstract

The ability of our sensory systems to merge sensory information from distinct modalities is remarkable. One stimulus characteristic utilized in this operation is temporal coincidence. Auditory and visual information are integrated within a narrow range of temporal offsets, known as the temporal binding window (TBW), which varies between individuals, stimulus type, and task. In this series of experiments, we assessed the relationship within individuals between the width of their TBW and their ability to integrate audiovisual information. The TBW was measured through a perceived subjective simultaneity task. In conjunction with this, we measured each individual's ability to integrate auditory and visual information with two multisensory illusions, the McGurk effect and Flashbeep illusion. The results from these studies demonstrate that the TBW is highly correlated with the individual's ability to integrate. These relationships were seen in only the right TBW, in which visual presentations preceded auditory presentations, a finding that is ecologically logical. However, differences were seen between the two illusory conditions, where the McGurk effect was stronger in individuals with narrow TBWs, again, an ecologically logical finding. The opposite relationship was seen with flashbeep illusion, possibly due to inherent asynchronies in the illusion.