Development of a mobile-based intelligent module for identification and tracking of household appliances

Abstract

Abstract Every year manufacturers of household appliances improve their devices, trying to make everyday life easier for users. New smart devices have many useful features, but not all users can easily cope with the complexity of the devices. One of the main tasks of household appliance manufacturers is to ensure the convenience of using appliances, taking into account the increasing complexity. Therefore, any manufacturer supplies equipment with a short but useful instruction manual. Practice shows that no printed user manual can compare with a demonstration of the device operation by a professional consultant. Instructions for home appliances using augmented reality technology will allow users to get the necessary detailed information about the device in a short period of time. As part of this work, the task of developing an artificial intelligence-based module is being solved. This module consists of developed classification, matching, and tracking submodules that can provide simple and fast visual instructions to users of household appliances in real time. The identification of household appliances is performed with more than 0.9 accuracy, and the tracking inside an unidentified object using the camera of a mobile device is processed with the success score of about 0.68 and frames per second (FPS) about 7. Mobile applications based on the proposed intelligent modules for Android and iOS were developed.