Visual information and communication context as modulators of interpersonal coordination in face-to-face and videoconference-based interactions

Abstract

Interpersonal coordination of body movement—or the similarity in patterning and timing of body movement between interaction partners over time—is a well-documented phenomenon in face-to-face (FTF) conversation. The present study will investigate the degree to which interpersonal coordination is impacted by the amount of visual information available and the type of interaction conversation partners are having. To do so within a naturalistic context, we take advantage of changes induced by the 2020 COVID-19 pandemic. The pandemic has changed communication, with mitigation efforts having forced nearly everyone to engage over videoconferencing (VC) platforms (which limit body visibility but not face visibility) or to meet FTF with public health constraints (which limit face visibility but not body visibility). We will ask 69 pairs of participants to communicate in one of three ways: (1) socially distanced FTF while wearing masks; (2) VC in a laboratory where each partner will see one another's full torso; or (3) VC in a remote setting where each partner will see only one another's face and shoulders. Each pair will hold three conversations: (a) affiliative, (b) argumentative, and (c) task-based. We will quantify interpersonal coordination by extracting overall amounts of movement from videos of the participants using well-validated computer vision methods and then calculating the relationship between the two participants' movement using nonlinear time series analyses. In doing so, we will be able to identify the degree to which visual information and conversational context shape the emergence of interpersonal coordination within now-naturalistic modes of interaction.

Keywords

• Interpersonal coordination
• Communication
• Videoconferencing
• Conversation
• Dynamics