A multi-task deep reinforcement learning-based recommender system for co-optimizing energy, comfort, and air quality in commercial buildings with humans-in-the-loop

Abstract

We introduce a novel human-centric deep reinforcement learning recommender system designed to co-optimize energy consumption, thermal comfort, and air quality in commercial buildings. Existing approaches typically optimize these objectives separately or focus solely on controlling energy-consuming building resources without directly engaging occupants. We develop a deep reinforcement learning architecture based on multitask learning with humans-in-the-loop and demonstrate how it can jointly learn energy savings, comfort, and air quality improvements for different building and occupant actions. In addition to controlling typical building resources (e.g., thermostat setpoint), our system provides real-time actionable recommendations that occupants can take (e.g., move to a new location) to co-optimize energy, comfort, and air quality. Through real deployments across multiple commercial buildings, we show that our multitask deep reinforcement learning recommender system has the potential to reduce energy consumption by up to 8% in energy-focused optimization, improve all objectives by 5–10% in joint optimization, and improve thermal comfort by up to 21% in comfort and air quality-focused optimization compared to existing solutions.

Keywords

• air quality
• building co-optimization
• deep reinforcement learning
• energy savings
• recommender system
• thermal comfort