rl-storm-control

KO | EN

gitlite — search

#javascript #python #react #deep-learning #linux #macos #java #windows #awesome #vue #awesome-list #security #pytorch #open-source

rl-storm-control

(★ 24)

Source code and data used in the Deep Reinforcement Learning for the Real Time Control of Stormwater Systems paper

rl-storm-control 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## Deep RL Agent for the RTC of Storm Water System

Source code and data used in the *Deep Reinforcement Learning for the Real Time Control of Stormwater Systems* paper.

![RLagent](https://raw.githubusercontent.com/kLabUM/rl-storm-control/master/data/RL_main_fig_1.png)

## Dependencies 
Code supports python 3.7 and python 2.7.

Python dependencies for the project can be installed using **requirements.txt**

Storm water network is simulated using EPA-SWMM and pyswmm/matswmm. Matswmm has been deprecated and we strongly suggest using pyswmm. 
 
pyswmm/matswmm makes function calls to a static c library. Hence, we advice gcc-8.0 for pyswmm and gcc-4.2 for matswmm.

## Agents

#### Classical Q Learning

Classical Q learning algorithm implementation for controlling the water level a single tank is provided in **classical_q**

This version observers the water level and sets the gate position between 0-100.

#### DQN
There are two types of deep rl agents.
1. Centralized controller that can observe multiple states across the network and control the ponds in the network 
2. Localised controller that can observe the state of an individual assent and control it

To use these agents to control a storm water network, you would just need to know the ID(e.g. "1D" from the swmm input file).

Refer to the example implementation for further details.

#### Training

University of Michigan's FLUX was used to train the agents. They can be run on any local computer too, but we **strongly** recommend a GPU.

## Utilities

Source code for generating heatmaps and other plots presented in the paper can be found in **./utilities**

## All the data used in the paper can be found here

https://drive.google.com/drive/folders/1PCixrjWy5TXMKn-VmIy0HpxWn4Jd2JrS?usp=sharing

## Further references 
1. Reinforcement Learning by Sutton and Barto
2. DQN
3. Batch Normalization

rl-storm-control

rl-storm-control 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

rl-storm-control

rl-storm-control 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README