Energy Management Strategy of Fuel Cell Electric Vehicles Using Model-Based Reinforcement Learning With Data-Driven Model Update

Abstract

Fuel cell electric vehicles use fuel cells as their main power source; the vehicle is driven by an electric motor, and have an electric battery as a secondary power source that stores regenerative braking energy and assists driving. To reduce the hydrogen fuel consumption by using these fuel cells and electric batteries efficiently, an energy management strategy is needed for the proper distribution of power among them. In this study, model-based reinforcement learning was utilized for energy management. For the optimal control of a fuel-cell electric vehicle, reinforcement learning is conducted using an internal vehicle powertrain model in the learning algorithm; initially, the model is completely unknown, but the model is learned with data from experiences as the learning process progresses. Then, reinforcement learning is conducted for the environment of the driving cycle profile to optimize the control policy. In this study, vehicle simulation was conducted using standard driving cycles, and the results showed that the learning process converged steadily and that the powertrain model was well learned. The simulated fuel consumption values show that the proposed algorithm reduces fuel consumption compared to the rule-based strategy by an average of 5.7%.

Keywords

• Fuel cell electric vehicles
• model-based reinforcement learning
• optimal control
• power management
• reinforcement learning