A curated list of awesome projects applying reinforcement learning (RL) to building control.
Before diving into the projects, it's worth mentioning some alternative names that often refer to some form of building control:
- building optimisation (BO)
- building energy optimisation (BEO)
- building energy management (BEM)
- energy management (EM)
- energy management system (EMS)
- home energy management (HEM)
- home energy management system (HEMS)
- smart building energy management (SBEM)
- demand-side management (DSM)
- building automation and control system (BACS)
- ...
With so many names it can be difficult to find what you are looking for – this list aims to help with this!
The following projects provide standarised RL environments that allow you to control a simulated building. Each environment gives access to a number of controllable devices in the simulated building, for example heating/cooling systems (HVAC), electric vehicle (EV) chargers or home batteries.
- Advanced Controls Testbed (ACTB) gym
- BOPTEST (second github) gym
- CityLearn gym
- COBS
- Energym
- GridLearn
- Gym-Eplus gym last-commit-over-a-year-ago
- ModelicaGym gym last-commit-over-a-year-ago
- RL-EmsPy
- RL Testbed for EnergyPlus gym
- Sinergym gym pip-installable
- Tropical Precooling Environment last-commit-over-a-year-ago
- Beobench1 gym pip-installable
Tags:
- gym: implements OpenAI Gym interface
- pip-installable: uploaded to PyPI (enables
pip install <package>)- last-commit-over-a-year-ago: last commit on linked repo was over a year ago
- General RL lists:
- Practical RL advice:
Did you find a mistake or something missing on the list? Either raise an issue in this repo or reach out to contact-gh (at) arduin.io. Thanks for your help!
Footnotes
-
Disclaimer: I created/contributed to this package, therefore put it last even though it's alphabetically first. ↩