Software system for contactless text input based on computer vision

Abstract

Abstract. The article is devoted to the problem of contactless human-computer interaction. The task of entering text from an optimized on-screen keyboard using cursor control based on data received from a video camera is considered, including if the user has motor impairments. A software system consisting of two applications is proposed for cursor control and text input based on computer vision algorithms. A diagram of the system operation and interaction of components and basic user settings are presented. As a result, testing was carried out using a focus group, in which participants had to enter free text using the proposed software system. Experiments have shown the functionality of the system.