Efficiency evaluation of speech and gesture interaction based on GOMS model

Abstract

Aiming at the problem that it is difficult to evaluate the interaction efficiency of new interaction means such as voice and gesture in the application of command and control system, based on the analysis of the interaction efficiency evaluation of traditional 2D graphical user interface GOMS, a human-computer interaction GOMS model oriented to augmented reality command is proposed. The model combines the features of 3D interface and multi-modal interaction in the augmented reality environment to improve the design. By analyzing the use time of different interaction modes and the influence of different interaction scenarios on the interaction operation time, the model predicts the time required by users to complete a certain task, quantifies the performance of different interaction modes, and provides basis and reference for the optimization design of the interaction system.

Keywords

• goms model|efficiency evaluation|gesture interaction|speech integration