Realization of Gesture Control Application on Openmv Board Using Optical Flow in Real-Time Video Images

Abstract

OpenMV Board is designed for purpose of non-complex image processing applications. It is an image processing sensor that has been a MicroPython embedded operating-system(OS). In the study, it is aimed to develop gesture control applications for electrical household appliances and small budget devices. Therefore, the hardware to be used should be cheap and the algorithm should be simple. Thus three gesture control applications have been developed by using OpenMv board for use in different electrical appliances. These are 1-level control, 2-multi-component simple system control and 3-page flip. The algorithmsused in the study are independent of the user because they are optical flow-based. Thus,the use of low-cost simple gesture control applications for industrial purposes (electricalappliances) can be realized. Algorithms developed for applications were written on the OpenMV IDE. These application results were monitored in real-time through the IDE. In addition, the algorithm developed for level control has been embedded and tested on an SD card on OpenMv independent of OpenMV IDE. During the test, output information was generated using OpenMV pins and the level indicator created using yellow, green and red LEDs connected to the pins was checked real-time. Thus, the algorithm was tested on a computer-independent embedded system.

Keywords

• gesture control
• low-cost control with image processing
• simple gesture control applications
• image processing sensors
• open source smartcam