Abstract
We present a modern stochastic control framework for dynamic optimization of river environment and ecology. We focus on fisheries in Japan and show several examples of simplified optimal control problems of stochastic differential equations modeling fishery resource dynamics, reservoir water balance dynamics, benthic algae dynamics, and sediment storage dynamics. These problems concern different phenomena with each other, but they all reduce to solving degenerate parabolic or elliptic equations. Optimal controls and value functions of these problems are computed using finite difference schemes. Finally, we present a higher-dimensional problem of controlling a dam-reservoir system using a semi-Lagrangian discretization on sparse grids. Our contribution shows the state-of-art of modeling, analysis, and computation of stochastic control in environmental engineering and science, and related research areas.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aino S, Yodo T, Yoshioka M (2015) Changes in the composition of stock origin and standard length of ayu Plecoglossus altivelis altivelis during the Tomozuri angling season in the Nagara River, central Japan. Fish Sci 81:37–42
Alla A, Falcone M, Kalise D (2015) An efficient policy iteration algorithm for dynamic programming equations. SIAM J. Sci. Comput. 37, A181–A200; Allawi MF, Jaafar O, Hamzah FM, El-Shafie A (2019) Novel reservoir system simulation procedure for gap minimization between water supply and demand. J Clean Prod 206:928–943
Azimzadeh P, Bayraktar E, Labahn G (2018) Convergence of implicit schemes for Hamilton-Jacobi-Bellman quasi-variational inequalities. SIAM J Control Optim 56:3994–4016
Barles G, Souganidis PE (1991) Convergence of approximation schemes for fully nonlinear second order equations. Asymptot Anal 4:271–283
Bian B, Dai M, Jiang L, Zhang Q, Zhong Y (2011) Optimal decision for selling an illiquid stock. J Optim Theory Appl 151:402–417
Bian B, Miao S, Zheng H (2011) Smooth value functions for a class of nonsmooth utility maximization problems. SIAM J Fin Math 2:727–747
Biswas IH, Chowdhury I, Jakobsen ER (2019) On the rate of convergence for monotone numerical schemes for nonlocal Isaacs equations. SIAM J Numer Anal 57:799–827
Bokanowski O, Garcke J, Griebel M, Klompmaker I (2013) An adaptive sparse grid semi-Lagrangian scheme for first order Hamilton-Jacobi Bellman equations. J Sci Comput 55:575–605
Botkin N, Turova V, Diepolder J, Bittner M, Holzapfel F (2017) Aircraft control during cruise flight in windshear conditions: viability approach. Dyn Games Appl 7:594–608
Bungartz HJ, Griebel M (2004) Sparse grids. Acta Numer 13:147–269
Calder J (2018) Lecture notes on viscosity solutions. Lecture notes at University of Minnesota. https://www-users.math.umn.edu/~jwcalder/viscosity_solutions.pdf
Capasso V, Bakstein D (2005) An introduction to continuous-time stochastic processes. Birkhäuser, Boston
Carlini E, Ferretti R, Russo G (2005) A weighted essentially nonoscillatory, large time-step scheme for Hamilton-Jacobi equations. SIAM J Sci Comput 27:1071–1091
Champagnat N, Ferrière R, Méléard S (2008) From individual stochastic processes to macroscopic models in adaptive evolution. Stoch Model 24(sup1):2–44
Cortes J (2008) Discontinuous dynamical systems. IEEE Control Syst Mag 28:36–73
Crandall MG, Ishii H, Lions PL (1992) User’s guide to viscosity solutions of second order partial differential equations. Bull Am Math Soc 27:1–67
Cullis JDS, McKnight DM, Spaulding SA (2015) Hydrodynamic control of benthic mats of Didymosphenia geminata at the reach scale. Can J Fish Aquat Sci 72:902–914
Désilles A, Zidani H (2019) Pareto front characterization for multiobjective optimal control problems using Hamilton-Jacobi Approach. SIAM J Control Optim 57:3884–3910
Doretto A, Bo T, Bona F, Apostolo M, Bonetto D, Fenoglio S (2019) Effectiveness of artificial floods for benthic community recovery after sediment flushing from a dam. Environ Monit Assess 191, Article No. 88
do Val JBR, Guillotreau P, Vallée T (2019) Fishery management under poorly known dynamics. Eur J Oper Res 279:242–257
Doyen L, Thébaud O, Béné C, Martinet V, Gourguet S, Bertignac M, Fifas S, Blanchard F (2012) A stochastic viability approach to ecosystem-based fisheries management. Ecol Econ 75:32–42
Dumitrescu R, Reisinger C, Zhang Y (2019) Approximation schemes for mixed optimal stopping and control problems with nonlinear expectations and jumps. Appl Math Optim (in press)
Falcone M, Paolucci G, Tozza S (2020) Multidimensional smoothness indicators for first-order Hamilton-Jacobi equations. J Comput Phys 409:109360
Ferretti R, Sassi A (2018) A semi-Lagrangian algorithm in policy space for hybrid optimal control problems. ESAIM: Control Optim Calculus Variations 24:965–983
Inui R, Akamatsu Y, Kakenami Y (2016) Quantification of cover degree of alien aquatic weeds and environmental conditions affecting the growth of Egeria densa in Saba River, Japan. J JSCE 72:I_1123–I_1128 (in Japanese with English Abstract)
Jiang GS, Peng D (2000) Weighted ENO schemes for Hamilton-Jacobi equations. SIAM J Sci Comput 21:2126–2143
Jiang H, Simonovic SP, Yu Z, Wang W (2020) A system dynamics simulation approach for environmentally friendly operation of a reservoir system. J Hydrol 587:124971
Kang W, Wilcox LC (2017) Mitigating the curse of dimensionality: sparse grid characteristics method for optimal feedback control and HJB equations. Comput Optim Appl 68:289–315
Katsoulakis MA (1994) Viscosity solutions of second order fully nonlinear elliptic equations with state constraints. Indiana Univ Math J 43:493–519
Katz SB, Segura C, Warren DR (2018) The influence of channel bed disturbance on benthic Chlorophyll a: a high resolution perspective. Geomorphology 305:141–153
Krylov NV (2018) Sobolev and viscosity solutions for fully nonlinear elliptic and parabolic equations. American Mathematical Society, Rhode Island
Kvamsdal SF, Poudel D, Sandal LK (2016) Harvesting in a fishery with stochastic growth and a mean-reverting price. Environ Resource Econ 63:643–663
Kvamsdal SF, Sandal LK, Poudel D (2020) Ecosystem wealth in the Barents Sea. Ecol Econ 171:106602
Lai J, Wan JW, Zhang S (2019) Numerical methods for two person games arising from transboundary pollution with emission permit trading. Appl Math Comput 350:11–31
Lessard J, Hicks DM, Snelder TH, Arscott DB, Larned ST, Booker D, Suren AM (2013) Dam design can impede adaptive management of environmental flows: a case study from the Opuha Dam, New Zealand. Environ Manage 51:459–473
Luce JJ, Steele R, Lapointe MF (2010) A physically based statistical model of sand abrasion effects on periphyton biomass. Ecol Model 221:353–361
Miyadi D (1960) The Ayu. Iwanami Shoten, Tokyo (in Japanese)
Murase A, Ishimaru T, Ogata Y, Yamasaki Y, Kawano H, Nakanishi K, Inoue K (2020) Where is the nursery for amphidromous nekton? Abundance and size comparisons of juvenile ayu among habitats and contexts. Estuar Coast Shelf Sci 241:106831
Nakamura T (2019) Numbers of anglers for the seas, inland waters, and inland fish species of Japan. Nippon Suisan Gakkaishi 85:398–405 (in Japanese with English Abstract)
Nakamura T (2020) Numbers of potential recreational anglers for the seas, inland waters, and inland fish species of Japan. Nippon Suisan Gakkaish, 19-00034 (in Japanese with English Abstract)
Nukazawa K, Kajiwara S, Saito T, Suzuki Y (2020) Preliminary assessment of the impacts of sediment sluicing events on stream insects in the Mimi River, Japan. Ecol Eng 145:105726
Øksendal B, Sulem A (2019) Applied stochastic control of jump diffusions. Springer, Cham
Olden JD, Naiman RJ (2010) Incorporating thermal regimes into environmental flows assessments: modifying dam operations to restore freshwater ecosystem integrity. Freshw Biol 55:86–107
Pham H (2002) Smooth solutions to optimal investment models with stochastic volatilities and portfolio constraints. Appl Math Optim 46:55–78
Pham H (2009) Continuous-time stochastic control and optimization with financial applications. Springer, Berlin, Heidelberg
Pham H, Tankov P (2009) A coupled system of integrodifferential equations arising in liquidity risk model. Appl Math Optim 59:147
Picarelli A, Reisinger C (2020) Probabilistic error analysis for some approximation schemes to optimal control problems. Syst Control Lett 137:104619
Picarelli A, Vargiolu T (2020) Optimal management of pumped hydroelectric production with state constrained optimal control. J Econ Dyn Control 103940 (in press)
Rathan, S, L 1-type smoothness indicators based WENO scheme for Hamilton-Jacobi equations. Int J Numer Methods Fluids 92:1927–1947 (In press)
Reed WJ (1988) Optimal harvesting of a fishery subject to random catastrophic collapse. Math Med Biol 5:215–235
Salgado AJ, Zhang W (2019) Finite element approximation of the Isaacs equation. ESAIM: Math Model Numer Anal 53:351–374
Schlomann BH (2018) Stationary moments, diffusion limits, and extinction times for logistic growth with random catastrophes. J Theor Biol 454:154–163
Shen J, Yu H (2010) Efficient spectral sparse grid methods and applications to high-dimensional elliptic problems. SIAM J Sci Comput 32:3228–3250
Smolar-Žvanut N, Mikoš M (2014) The impact of flow regulation by hydropower dams on the periphyton community in the Soča River, Slovenia. Hydrol Sci J 59(5):1032–1045. https://doi.org/10.1080/02626667.2013.834339
Sohoulande CD, Stone K, Singh VP (2019) Quantifying the probabilistic divergences related to time-space scales for inferences in water resource management. Agric Water Manag 217:282–291
Song X, Zhong D, Wang G, Li X (2020) Stochastic evolution of hydraulic geometry relations in the lower Yellow River under environmental uncertainties. Int J Sedim Res 35:328–346
Stähly S, Franca MJ, Robinson CT, Schleiss AJ (2019) Sediment replenishment combined with an artificial flood improves river habitats downstream of a dam. Sci Rep 9:1–8
Steinfeld CMM, Sharma A, Mehrotra R, Kingsford RT (2020) The human dimension of water availability: influence of management rules on water supply for irrigated agriculture and the environment. J Hydrol 588:125009
Tago Y (2003) Number of Ayu caught by cast and tenkara nets at several depths in a concrete pond. Suisanzoshoku 51:225–226 (in Japanese with English Abstract)
Takai N, Kawabe K, Togura K, Kawasaki K, Kuwae T (2018) The seasonal trophic link between Great Cormorant Phalacrocorax carbo and ayu Plecoglossus altivelis altivelis reared for mass release. Ecol Res 33(5):935–948
Thomas LH (1949) Elliptic problems in linear difference equations over a network. Watson Sci. Comp. Lab. Rep, Columbia University, New York
Touzi N (2012) Optimal stochastic control, stochastic target problems, and backward SDE. Springer, New York
Wang H (2001) Some control problems with random intervention times. Adv Appl Probab 33:404–422
Wang H, Li Y, Li J, An R, Zhang L, Chen M (2018) Influences of hydrodynamic conditions on the biomass of benthic diatoms in a natural stream. Ecol Ind 92:51–60
Ware A (2018) Reliability-constrained hydropower valuation. Energy Policy 118:633–641
Warin X (2014) Adaptive sparse grids for time dependent Hamilton-Jacobi-Bellman equations in stochastic control. arXiv preprint arXiv:1408.4267
Wong M, Parker G (2006) Reanalysis and correction of bed-load relation of Meyer-Peter and Müller using their own database. J Hydraul Eng 132:1159–1168
Wu Y, Chen J (2013) Investigating the effects of point source and nonpoint source pollution on the water quality of the East River (Dongjiang) in South China. Ecol Ind 32:294–304
Yaegashi Y, Yoshioka H, Unami K, Fujihara M (2018) A singular stochastic control model for sustainable population management of the fish-eating waterfowl Phalacrocorax carbo. J Environ Manage 219:18–27
Yang B, Dou M, Xia R, Kuo YM, Li G, Shen L (2020) Effects of hydrological alteration on fish population structure and habitat in river system: a case study in the mid-downstream of the Hanjiang River in China. Glob Ecol Conserv 23:e01090
Yin GG, Zhu C (2009) Hybrid switching diffusions: properties and applications. Springer, New York, Dordrecht, Heidelberg, London
Yong J (2020) Stochastic optimal control-A concise introduction. Math Control Related Fields (in press). https://doi.org/10.3934/mcrf.2020027
Yoshioka H (2019) A simplified stochastic optimization model for logistic dynamics with control-dependent carrying capacity. J Biol Dyn 13:148–176
Yoshioka H (2020a) River environmental restoration based on random observations of a non-smooth stochastic dynamical system. arXiv preprint arXiv:2005.04817
Yoshioka H (2020b) Mathematical modeling and computation of a dam-reservoir system balancing environmental management and hydropower generation. In: 2020 7th International Conference on Power and Energy Systems Engineering (CPESE 2020), September 26–29, 2020, Fukuoka Institute of Technology, Fukuoka, Japan (Accepted on May 15, 2020). Full paper, 4 p. (In press)
Yoshioka H, Yaegashi Y (2017) Stochastic optimization model of aquacultured fish for sale and ecological education. J Math Ind 7:1–23
Yoshioka H, Yaegashi Y (2018) Mathematical analysis for management of released fish. Optimal Control Appl Methods 39:1141–1146
Yoshioka H, Yaegashi Y (2018) Robust stochastic control modeling of dam discharge to suppress overgrowth of downstream harmful algae. Appl Stoch Model Bus Ind 34:338–354
Yoshioka H, Yaegashi Y (2018) Stochastic differential game for management of non-renewable fishery resource under model ambiguity. J Biol Dyn 12:817–845
Yoshioka H, Yaegashi Y, Yoshioka Y, Hamagami K, Fujihara M (2019) A primitive model for stochastic regular-impulse population control and its application to ecological problems. Adv Control Appl Eng Ind Syst 1:e16
Yoshioka H, Yaegashi Y, Yoshioka Y, Tsugihashi K (2019) A short note on analysis and application of a stochastic open-ended logistic growth model. Lett Biomath 6:67–77
Yoshioka H, Yaegashi Y, Yoshioka Y, Hamagami K (2019) Hamilton–Jacobi–Bellman quasi-variational inequality arising in an environmental problem and its numerical discretization. Comput Math Appl 77:2182–2206
Yoshioka H, Tanaka T, Aranishi F, Izumi T, Fujihara M (2019) Stochastic optimal switching model for migrating population dynamics. J Biol Dyn 13:706–732
Yoshioka H, Hamagami K, Tujimura Y, Yoshioka Y, Yaegashi Y (2020) Chapter 3. Hydraulic control of the benthic alga Cladophora glomerata. In: Ayu and river environment in Hii River, Japan—research results from 2015 to 2020. Published by Laboratory of Mathematical Sciences for Environment and Ecology, Shimane University (in Japanese). Available at https://www.hiikawafish.jp/date/200300ayutokankyo.pdf
Yoshioka H, Yaegashi Y (2020) Optimally controlling a non-smooth environmental system with random observation and execution delay. In: 18th International Conference of Numerical Analysis and Applied Mathematics (ICNAAM2020), September 17–23, Sheraton Hotel, Rhodes, Greece (in press)
Yoshioka H, Yoshioka Y (2019) Modeling stochastic operation of reservoir under ambiguity with an emphasis on river management. Optim Control Appl Methods 40(4):764–790
Zhang YT, Zhao HK, Qian J (2006) High order fast sweeping methods for static Hamilton-Jacobi equations. J Sci Comput 29:25–56
Acknowledgements
JSPS KAKENHI 19H03073, Kurita Water and Environment Foundation Grant 19B018 and 20K004, and grants from MLIT Japan for surveys of the landlocked P. altivelis and management of seaweeds in Lake Shinji support this research. The author gratefully thanks to Dr. Srikanta Patnaik for his invitation to this volume.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Yoshioka, H. (2021). Mathematical and Computational Approaches for Stochastic Control of River Environment and Ecology: From Fisheries Viewpoint. In: Patnaik, S., Tajeddini, K., Jain, V. (eds) Computational Management. Modeling and Optimization in Science and Technologies, vol 18. Springer, Cham. https://doi.org/10.1007/978-3-030-72929-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-72929-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-72928-8
Online ISBN: 978-3-030-72929-5
eBook Packages: Business and ManagementBusiness and Management (R0)