Abstract
In this paper, the authors are concerned with Pump Scheduling Optimization in Water Distribution Networks, targeted on the minimization of the energy costs subject to operational constraints, such as satisfying demand, keeping pressures within certain bounds to reduce leakage and the risk of pipe burst, and keeping reservoir levels within bounds to avoid overflow. Urban water networks are generating huge amounts of data from flow/pressure sensors and smart metering of household consumption. Traditional optimization strategies fail to capture the value hidden in real time data assets. In this paper the authors are proposing a sequential optimization method based on Approximate Dynamic Programming in order to find a control policy defined as a mapping from states of the system to actions, i.e. pump settings. Q-Learning, one of the Approximate Dynamic Programming algorithms, well known in the Reinforcement Learning community, is used. The key difference is that usual Mathematical Programming approaches, including stochastic optimization, requires knowing the water demand in advance or, at least, to have a reliable and accurate forecasting. On the contrary, Approximate Dynamic Programming provides a policy, that is a strategy to decide how to act time step to time step according to the observation of the physical system. Results on the Anytown benchmark network proved that the optimization policy/strategy identified through Approximate Dynamic Programming is robust with respect to modifications of the water demand and, therefore, able to deal with real time data without any distributional assumption.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bellman, R.E.: Dynamic Programming. Princeton University Press, Princeton (1957)
Candelieri, A., Soldi, D., Archetti, F.: Short-term forecasting of hourly water consumption by using automatic metering readers data. Procedia Eng. 119, 844–853 (2015)
Candelieri, A.: Clustering and Support Vector Regression for Water Demand Forecasting and Anomaly Detection. Water 9(3), 224 (2017)
De Paola, F., Fontana, N., Giugni, M., Marini, G., Pugliese, F.: An application of the Harmony-Search Multi-Objective (HSMO) optimization algorithm for the solution of pump scheduling problem. Procedia Eng. 162, 494–502 (2016)
Ertin, E., Dean, A.N., Moore, M.L., Priddy, K.L.: Dynamic optimization for optimal control of water distribution systems. Applications and science of computational intelligence IV. Proc. SPIE 4390, 142–149 (2001)
Fracasso, P.T., Barnes, F.S., Costa, A.H.R.: Energy cost optimization in water distribution systems using Markov decision processes. In: International Green Computing Conference Proceedings, Arlington, pp. 1–6 (2013)
Fracasso, P.T., Barnes, F.S., Costa, A.H.R.: Optimized Control for Water Utilities. Procedia Eng. 70, 678–687 (2014)
Howard, R.A.: Dynamic Programming and Markov Processes. MIT Press, Cambridge (1960)
Ikonen, E., Bene, J.: Scheduling and disturbance control of a water distribution network. In: Proceedings of 18th World Congress of the International Federation of Automatic Control (IFAC 2011), Milano, Italy (2011)
Ikonen, E., Selek, I., Tervaskanto, M.: Short-term pump schedule optimization using MDP and neutral GA. IFAC Proc. Vol. 43(1), 315–320 (2010)
Mala-Jetmarova, H., Sultanova, N., Savic, D.: Lost in optimization of water distribution systems? A literature review of system operations. Environ. Model. Softw. 93, 209–254 (2017)
Pasha, M.F.K., Lansey, K.: Optimal pump scheduling by linear programming. In: Proceedings of World Environmental and Water Resources Congress 2009 - World Environmental and Water Resources Congress 2009: Great Rivers, vol. 342, pp. 395–404 (2009)
Powell, W.B.: Approximate Dynamic Programming: Solving the Curses of Dimensionality. Wiley, New York (2007)
Puterman, M.: Markov Decision Processes. Discrete Stochastic Dynamic Programming. Wiley, New York (1994)
Shabani, S., Candelieri, A., Archetti, F., Naser, G.: Gene expression programming coupled with unsupervised learning: a two-stage learning process in multi-scale, short-term water demand forecasts. Water 10(2), 142 (2018)
Sterling, M.J.H., Coulbeck, B.: A dynamic programming solution to the optimization of pumping costs, in Hybrid genetic algorithm in the optimization of energy costs in water supply networks. ICE Proc. 59(2), 813–818 (1975)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An introduction – Adaptive Computation and Machine Learning. MIT Press, Cambridge (1998)
Wiering, M., Van Otterlo, M.: Reinforcement Learning - State-of-the- Art, 1st edn. Springer, Berlin (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Candelieri, A., Perego, R., Archetti, F. (2019). Intelligent Pump Scheduling Optimization in Water Distribution Networks. In: Battiti, R., Brunato, M., Kotsireas, I., Pardalos, P. (eds) Learning and Intelligent Optimization. LION 12 2018. Lecture Notes in Computer Science(), vol 11353. Springer, Cham. https://doi.org/10.1007/978-3-030-05348-2_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-05348-2_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05347-5
Online ISBN: 978-3-030-05348-2
eBook Packages: Computer ScienceComputer Science (R0)