Home > Research > Publications & Outputs > Water Pressure Optimisation for Leakage Managem...

Electronic data


Text available via DOI:

View graph of relations

Water Pressure Optimisation for Leakage Management Using Q Learning

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Publication date2/08/2023
Host publicationProceedings - 2023 IEEE Conference on Artificial Intelligence, CAI 2023
Number of pages2
ISBN (electronic)9798350339840
ISBN (print)9798350339857
<mark>Original language</mark>English

Publication series

Name2023 IEEE Conference on Artificial Intelligence (CAI)


The recent global urbanization problem has set the industry and researchers sights to the importance of safe, effective water distribution due to the unprecedent demand placed on our aging water networks. Our current water practices often increase the degradation of assets through heightened pressures causing more failures and leakage. Whilst the higher network pressures ensure customer demands are met; they cause detrimental failures to the system, long-term expenses, higher carbon emissions and energy consumption. This paper uses a baseline reinforcement learning algorithm to optimize valve set point for active pressure control. Using optimized Q-learning in an EPANET-Python environment, the agent learns to modify valve set points to decrease the average pressures whilst remaining within the OFWAT mandated pressure limits of 10m. This code is tested on the d-town test network. The agent shows continuous improvement finding an optimized set point of 26m and dropping the average system pressure by 2% by making simple changes to two pressure reducing valves. The agent learns the optimal actions to take for different states however further improvements can be made through the use of deep neural networks.