Speech-driven embodied entrainment character system with a voice back-channel

Abstract

We have already developed a speech-driven embodied entrainment CG character system called “InterActor” which generates communicative motions and actions such as nods for entrained interaction from speech rhythm based on only voice input. Conventional InterActor performed the entrained communicative body movements and actions based on speech input without a voice back-channel. In this study, we develop an embodied character system with the voice backchannel based on the embodied interaction model. Two experiments are performed to confirm the effectiveness of the system by sensory evaluation. In the first experiment, the effects of the automatic generation and presentation method of the voice back-channel are examined in each situation with and without character presentation. In the second experiment, the frequency of the voice back-channel to nodding motion is examined. The effectiveness of the system is confirmed from these experimental results.

Keywords

• embodied interaction
• entrainment
• communicative agent
• back-channel
• nodding