Engineering design optimisation using reinforcement learning with episodic controllers

Abstract

Abstract Engineers solving engineering design problems can be regarded as a gradual optimisation process that involves strategising. The process can be modelled as a reinforcement learning (RL) framework. This article presents an RL model with episodic controllers to solve engineering problems. Episodic controllers provide a mechanism for using the short‐term and long‐term memories to improve the efficiency of searching for engineering problem solutions. This work demonstrates that the two kinds of models of memories can be incorporated into the existing RL framework. Finally, an optimised design problem of a crane girder is illustrated by RL with episodic controllers. The work presented in this study leverages the RL model that has been shown to mimic human problem solving in engineering optimised design problems.

Keywords

• crane girder
• engineering design
• episodic control
• memory system
• reinforcement learning