A nodding detection system based on the active appearance model

Abstract

In face-to-face conversation, embodied rhythms between speech and body movements such as nodding are mutually synchronized between talkers such as a speaker and a listener. This synchrony is called entrainment in communication and it generates the sharing of embodiment in human interaction. Embodied communication, which is closely related to behavioral and physiological entrainment, is an essential form of communication that forms the basis of interaction between talkers through mutual embodiment. In particular, nodding has an important role as a regulator in embodied interaction and communication. The detection of nodding is useful for an estimation of the activity of conversation. In this paper, we develop a nodding detection system using a nodding detection model based on an analysis of the head movement involved in nodding. This model detects nodding based on the rotational movement of the head, which is estimated from the face tracking of the Active Appearance Model. The effectiveness of the system is demonstrated by comparing the result of the nodding detection results with visual inspection. The developed nodding detection system is demonstrated in an actual event for children.

Keywords

• human interface
• human interaction
• human-machine communication
• kansei and embodiment
• image processing
• active appearance model