IEEE Access (Jan 2021)

Pharmaceutical Blister Package Identification Based on Induced Deep Learning

  • Yun Han,
  • Sheng-Luen Chung,
  • Qiang Xiao,
  • Jing-Syuan Wang,
  • Shun-Feng Su

DOI
https://doi.org/10.1109/ACCESS.2021.3097181
Journal volume & issue
Vol. 9
pp. 101344 – 101356

Abstract

Read online

Prescription dispensing accuracy is of paramount importance for all hospitals. However, human errors are inevitable due to multiple reasons, such as fatigue, stress, heavy workload, lack of effective verification measures, mismanagement. Such human errors pose serious safety and health concerns on the part of patients and may as well lead to a series of medical disputes. Based on induced deep learning, this paper proposes a real-time Blister Package Identification System (BPIS) to assist pharmacists’ drug verification and dispensing. Under the guidance of the induction strategy, image preprocessing is introduced to form a standardized image containing the front and back side of the blister package, which is subsequently sent to CNN-based object identification network for feature extraction and identification. This preprocessing method allows the identification system to promote the deep learning system to focus on feature learning to obtain more information about the appearance of the package ruling out confounding factors such as background noise, size, shape or positioning. In addition, this article collects and establishes an image dataset of adult lozenges. Under this dataset, this paper verifies the enhancement of Induced Deep Learning (IDL) on YOLO v2, ResNet, and SENet. By optimizing the deep learning identification network with the help of the embedded technology and a two-side extraction mechanism, a real-time BPIS is built. Long-term tests in hospitals prove the effectiveness of the proposed system.

Keywords