Maintenance strategy of ship multi-state deterioration system under reinforcement learning mode

Abstract

ObjectivesNaval ship systems such as the hull structure, weapons equipment and power equipment will deteriorate during their service life. Thus, a ship maintenance strategy based on the actual deterioration state is essential for ensuring the safety and availability of naval ships. MethodsIn this paper, a multi-state deterioration system model is established on the basis of the Markov decision process. A reinforcement learning mode is then introduced to train the agent that generates the maintenance strategy, and the optimal condition-based maintenance strategy is obtained in the process of adaptive learning. ResultsThe proposed method is applied to a ship structural deterioration system for demonstration, and the results show that it can obtain the optimal maintenance policy for a multi-state deterioration system considering the actual conditions, thereby providing an intelligent supporting tool for decision-makers to formulate optimal ship maintenance strategies. ConclusionsThis paper shows that the reinforcement learning method has great potential in comprehensively improving ship maintenance support.

Keywords

• ship maintenance
• reinforcement learning
• markov decision process
• condition-based maintenance