IEEE Access (Jan 2020)

Vision-Based Fault Diagnostics Using Explainable Deep Learning With Class Activation Maps

  • Kyung Ho Sun,
  • Hyunsuk Huh,
  • Bayu Adhi Tama,
  • Soo Young Lee,
  • Joon Ha Jung,
  • Seungchul Lee

DOI
https://doi.org/10.1109/ACCESS.2020.3009852
Journal volume & issue
Vol. 8
pp. 129169 – 129179

Abstract

Read online

In the era of the fourth industrial revolution (Industry 4.0) and the Internet of Things (IoT), real-time data is enormously collected and analyzed from mechanical equipment. By classifying and characterizing the measured signals, the fault condition of mechanical components could be identified. However, most current health monitoring techniques utilize time-consuming and labor-intensive feature engineering, i.e., feature extraction and selection, that are carried out by experts. This paper, on the contrary, deals with an automatic diagnosis method of machine monitoring using a convolutional neural network (CNN) with class activation maps (CAM). A class activation map enables us to discriminate the fault region in the images, thus allowing us to localize the fault precisely. The goal of the paper is to demonstrate how CNN and CAM could be employed to real-world vibration video to characterize the machine's status, representing normal or fault conditions. The performance of the proposed model is validated with a base-excited cantilever beam dataset and a water pump dataset. This paper presents a novel industrial application by developing a promising method for automatic machine condition-based monitoring.

Keywords