Real-Time Diagnostic Technique for AI-Enabled System

Abstract

The last few decades have witnessed a dramatic evolution of Artificial Intelligence (AI) algorithms, represented by Deep Neural Networks (DNNs), resulting in AI-enabled systems being significantly dominant in various fields, including robotics, healthcare, and mobility. AI-enabled systems are currently used even for safety-critical applications, including automated driving, where they encounter reliability challenges from both hardware (HW) and software (SW) perspectives. However, there is no effective technique available that can diagnose HW and SW of AI-enabled systems in real-time during operation. Therefore, this paper proposes an intelligent real-time diagnostic technique for detecting HW and SW anomalies of AI-enabled systems and continuously improving the SW quality during operation. The proposed technique can detect HW anomalies to avoid unexpected changes in AI parameters and subsequent AI performance degradation using single context data with a detection accuracy of more than 92%. The proposed technique can also detect SW anomalies and identify edge cases in real-time, which could result in performance degradation by more than 50% compared to normal conditions. The identified edge cases can be used to continuously enhance the SW quality. Experimental results show the effectiveness of the technique for practical applications and thus can contribute to realize reliable and improved AI-enabled systems.

Keywords

• Artificial intelligence (AI)
• AI-enabled system
• real-time monitoring
• diagnostic technology
• system reliability