Reinforcement Learning-Based School Energy Management System

Yassine Chemingui, Adel Gastli, Omar Ellabban

Abstract:

Energy efficiencyis a key to reduced carbon footprint, savings on energy bills, and sustainability
for future generations. For instance, in hot climate countries such as Qatar, buildings are high
energy consumers due to air conditioning that resulted from high temperatures and humidity.
Optimizing the building energy management system will reduce unnecessary energy consumptions,
improve indoor environmental conditions, maximize building occupant’s comfort, and limit building
greenhouse gas emissions. However, lowering energy consumption cannot be done despite
the occupants’ comfort. Solutions must take into account these tradeoffs. Conventional Building Energy
Management methods suffer from a high dimensional and complex control environment. In recent years,
the Deep Reinforcement Learning algorithm, applying neural networks for function approximation,
shows promising results in handling such complex problems. In this work, a Deep Reinforcement
Learning agent is proposed for controlling and optimizing a school building’s energy consumption. It
is designed to search for optimal policies to minimize energy consumption, maintain thermal comfort,
and reduce indoor contaminant levels in a challenging 21-zone environment. First, the agent is trained
with the baseline in a supervised learning framework. After cloning the baseline strategy, the agent
learns with proximal policy optimization in an actor-critic framework. The performance is evaluated
on a school model simulated environment considering thermal comfort, CO2 levels, and energy
consumption. The proposed methodology can achieve a 21% reduction in energy consumption, a 44%
better thermal comfort, and healthier CO2 concentrations over a one-year simulation, with reduced
training time thanks to the integration of the behavior cloning learning technique.