Sign Language Recognition Based on Image-interpreted Mechanomyography and Convolution Neural Network

Abstract

Time series signals are widely used in various pattern recognition applications.In order to solve the problem of low pattern recognition rate of time series signals for a large number of targets,this article uses a variety of transform methods to convert time series signals into images,and performes pattern recognition using image classification algorithms.In the experiment,the mechanomyography (MMG) corresponding to 30 sign languages on the forearm are collected and converted into diffe-rent image styles,and a convolution neural network (CNN) framework is designed to establish pattern recognition classification models for the images.The models are optimized twice with the application of transfer learning algorithm,and the recognition rate of the best classification model reaches 98.7%,which is much higher than the recognition rate of traditional machine learning algorithms.The experimental results imply that the image processing of time series signals can effectively improve the recognition rate of multi-target pattern recognition of MMG.This paper can provide references for pattern recognition of other time series signal.

Keywords

• mechanomyography|pattern recognition|image-interpreted time series signal|convolution neural network|transfer learning