A Reinforcement Learning Approach for Integrating an Intelligent Home Energy Management System with a Vehicle-to-Home Unit

Abstract

These days, users consume more electricity during peak hours, and electricity prices are typically higher between 3:00 p.m. and 11:00 p.m. If electric vehicle (EV) charging occurs during the same hours, the impact on residential distribution networks increases. Thus, home energy management systems (HEMS) have been introduced to manage the energy demand among households and EVs in residential distribution networks, such as a smart micro-grid (MG). Moreover, HEMS can efficiently manage renewable energy sources, such as solar photovoltaic (PV) panels, wind turbines, and vehicle energy storage. Until now, no HEMS has intelligently coordinated the uncertainty of smart MG elements. This paper investigated the impact of PV solar power, MG storage, and EVs on the maximum solar radiation hours. Several deep learning (DL) algorithms were utilized to account for the uncertainties. A reinforcement learning home centralized photovoltaic (RL-HCPV) scheduling algorithm was developed to manage the energy demand between the smart MG elements. The RL-HCPV system was modelled according to several constraints to meet household electricity demands in sunny and cloudy weather. Additionally, simulations demonstrated how the proposed RL-HCPV system could incorporate uncertainty, and efficiently handle the demand response and how vehicle-to-home (V2H) can help to level the appliance load profile and reduce power consumption costs with sustainable power production. The results demonstrated the advantages of utilizing RL and V2H technology as potential smart building storage technology.

Keywords

• deep learning
• home energy management system
• Q-learning
• reinforcement learning solar photovoltaic
• vehicle-to-home