Skip to main content

Mathematical and Computational Approaches for Stochastic Control of River Environment and Ecology: From Fisheries Viewpoint

  • Chapter
  • First Online:
Computational Management

Part of the book series: Modeling and Optimization in Science and Technologies ((MOST,volume 18))

Abstract

We present a modern stochastic control framework for dynamic optimization of river environment and ecology. We focus on fisheries in Japan and show several examples of simplified optimal control problems of stochastic differential equations modeling fishery resource dynamics, reservoir water balance dynamics, benthic algae dynamics, and sediment storage dynamics. These problems concern different phenomena with each other, but they all reduce to solving degenerate parabolic or elliptic equations. Optimal controls and value functions of these problems are computed using finite difference schemes. Finally, we present a higher-dimensional problem of controlling a dam-reservoir system using a semi-Lagrangian discretization on sparse grids. Our contribution shows the state-of-art of modeling, analysis, and computation of stochastic control in environmental engineering and science, and related research areas.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aino S, Yodo T, Yoshioka M (2015) Changes in the composition of stock origin and standard length of ayu Plecoglossus altivelis altivelis during the Tomozuri angling season in the Nagara River, central Japan. Fish Sci 81:37–42

    Google Scholar 

  2. Alla A, Falcone M, Kalise D (2015) An efficient policy iteration algorithm for dynamic programming equations. SIAM J. Sci. Comput. 37, A181–A200; Allawi MF, Jaafar O, Hamzah FM, El-Shafie A (2019) Novel reservoir system simulation procedure for gap minimization between water supply and demand. J Clean Prod 206:928–943

    Google Scholar 

  3. Azimzadeh P, Bayraktar E, Labahn G (2018) Convergence of implicit schemes for Hamilton-Jacobi-Bellman quasi-variational inequalities. SIAM J Control Optim 56:3994–4016

    MathSciNet  MATH  Google Scholar 

  4. Barles G, Souganidis PE (1991) Convergence of approximation schemes for fully nonlinear second order equations. Asymptot Anal 4:271–283

    MathSciNet  MATH  Google Scholar 

  5. Bian B, Dai M, Jiang L, Zhang Q, Zhong Y (2011) Optimal decision for selling an illiquid stock. J Optim Theory Appl 151:402–417

    MathSciNet  MATH  Google Scholar 

  6. Bian B, Miao S, Zheng H (2011) Smooth value functions for a class of nonsmooth utility maximization problems. SIAM J Fin Math 2:727–747

    MathSciNet  MATH  Google Scholar 

  7. Biswas IH, Chowdhury I, Jakobsen ER (2019) On the rate of convergence for monotone numerical schemes for nonlocal Isaacs equations. SIAM J Numer Anal 57:799–827

    MathSciNet  MATH  Google Scholar 

  8. Bokanowski O, Garcke J, Griebel M, Klompmaker I (2013) An adaptive sparse grid semi-Lagrangian scheme for first order Hamilton-Jacobi Bellman equations. J Sci Comput 55:575–605

    MathSciNet  MATH  Google Scholar 

  9. Botkin N, Turova V, Diepolder J, Bittner M, Holzapfel F (2017) Aircraft control during cruise flight in windshear conditions: viability approach. Dyn Games Appl 7:594–608

    MathSciNet  MATH  Google Scholar 

  10. Bungartz HJ, Griebel M (2004) Sparse grids. Acta Numer 13:147–269

    MathSciNet  MATH  Google Scholar 

  11. Calder J (2018) Lecture notes on viscosity solutions. Lecture notes at University of Minnesota. https://www-users.math.umn.edu/~jwcalder/viscosity_solutions.pdf

  12. Capasso V, Bakstein D (2005) An introduction to continuous-time stochastic processes. Birkhäuser, Boston

    MATH  Google Scholar 

  13. Carlini E, Ferretti R, Russo G (2005) A weighted essentially nonoscillatory, large time-step scheme for Hamilton-Jacobi equations. SIAM J Sci Comput 27:1071–1091

    MathSciNet  MATH  Google Scholar 

  14. Champagnat N, Ferrière R, Méléard S (2008) From individual stochastic processes to macroscopic models in adaptive evolution. Stoch Model 24(sup1):2–44

    MathSciNet  MATH  Google Scholar 

  15. Cortes J (2008) Discontinuous dynamical systems. IEEE Control Syst Mag 28:36–73

    MathSciNet  MATH  Google Scholar 

  16. Crandall MG, Ishii H, Lions PL (1992) User’s guide to viscosity solutions of second order partial differential equations. Bull Am Math Soc 27:1–67

    MathSciNet  MATH  Google Scholar 

  17. Cullis JDS, McKnight DM, Spaulding SA (2015) Hydrodynamic control of benthic mats of Didymosphenia geminata at the reach scale. Can J Fish Aquat Sci 72:902–914

    Google Scholar 

  18. Désilles A, Zidani H (2019) Pareto front characterization for multiobjective optimal control problems using Hamilton-Jacobi Approach. SIAM J Control Optim 57:3884–3910

    MathSciNet  MATH  Google Scholar 

  19. Doretto A, Bo T, Bona F, Apostolo M, Bonetto D, Fenoglio S (2019) Effectiveness of artificial floods for benthic community recovery after sediment flushing from a dam. Environ Monit Assess 191, Article No. 88

    Google Scholar 

  20. do Val JBR, Guillotreau P, Vallée T (2019) Fishery management under poorly known dynamics. Eur J Oper Res 279:242–257

    Google Scholar 

  21. Doyen L, Thébaud O, Béné C, Martinet V, Gourguet S, Bertignac M, Fifas S, Blanchard F (2012) A stochastic viability approach to ecosystem-based fisheries management. Ecol Econ 75:32–42

    Google Scholar 

  22. Dumitrescu R, Reisinger C, Zhang Y (2019) Approximation schemes for mixed optimal stopping and control problems with nonlinear expectations and jumps. Appl Math Optim (in press)

    Google Scholar 

  23. Falcone M, Paolucci G, Tozza S (2020) Multidimensional smoothness indicators for first-order Hamilton-Jacobi equations. J Comput Phys 409:109360

    MathSciNet  MATH  Google Scholar 

  24. Ferretti R, Sassi A (2018) A semi-Lagrangian algorithm in policy space for hybrid optimal control problems. ESAIM: Control Optim Calculus Variations 24:965–983

    MathSciNet  MATH  Google Scholar 

  25. Inui R, Akamatsu Y, Kakenami Y (2016) Quantification of cover degree of alien aquatic weeds and environmental conditions affecting the growth of Egeria densa in Saba River, Japan. J JSCE 72:I_1123–I_1128 (in Japanese with English Abstract)

    Google Scholar 

  26. Jiang GS, Peng D (2000) Weighted ENO schemes for Hamilton-Jacobi equations. SIAM J Sci Comput 21:2126–2143

    MathSciNet  MATH  Google Scholar 

  27. Jiang H, Simonovic SP, Yu Z, Wang W (2020) A system dynamics simulation approach for environmentally friendly operation of a reservoir system. J Hydrol 587:124971

    Google Scholar 

  28. Kang W, Wilcox LC (2017) Mitigating the curse of dimensionality: sparse grid characteristics method for optimal feedback control and HJB equations. Comput Optim Appl 68:289–315

    MathSciNet  MATH  Google Scholar 

  29. Katsoulakis MA (1994) Viscosity solutions of second order fully nonlinear elliptic equations with state constraints. Indiana Univ Math J 43:493–519

    MathSciNet  MATH  Google Scholar 

  30. Katz SB, Segura C, Warren DR (2018) The influence of channel bed disturbance on benthic Chlorophyll a: a high resolution perspective. Geomorphology 305:141–153

    Google Scholar 

  31. Krylov NV (2018) Sobolev and viscosity solutions for fully nonlinear elliptic and parabolic equations. American Mathematical Society, Rhode Island

    MATH  Google Scholar 

  32. Kvamsdal SF, Poudel D, Sandal LK (2016) Harvesting in a fishery with stochastic growth and a mean-reverting price. Environ Resource Econ 63:643–663

    Google Scholar 

  33. Kvamsdal SF, Sandal LK, Poudel D (2020) Ecosystem wealth in the Barents Sea. Ecol Econ 171:106602

    Google Scholar 

  34. Lai J, Wan JW, Zhang S (2019) Numerical methods for two person games arising from transboundary pollution with emission permit trading. Appl Math Comput 350:11–31

    MathSciNet  MATH  Google Scholar 

  35. Lessard J, Hicks DM, Snelder TH, Arscott DB, Larned ST, Booker D, Suren AM (2013) Dam design can impede adaptive management of environmental flows: a case study from the Opuha Dam, New Zealand. Environ Manage 51:459–473

    Google Scholar 

  36. Luce JJ, Steele R, Lapointe MF (2010) A physically based statistical model of sand abrasion effects on periphyton biomass. Ecol Model 221:353–361

    Google Scholar 

  37. Miyadi D (1960) The Ayu. Iwanami Shoten, Tokyo (in Japanese)

    Google Scholar 

  38. Murase A, Ishimaru T, Ogata Y, Yamasaki Y, Kawano H, Nakanishi K, Inoue K (2020) Where is the nursery for amphidromous nekton? Abundance and size comparisons of juvenile ayu among habitats and contexts. Estuar Coast Shelf Sci 241:106831

    Google Scholar 

  39. Nakamura T (2019) Numbers of anglers for the seas, inland waters, and inland fish species of Japan. Nippon Suisan Gakkaishi 85:398–405 (in Japanese with English Abstract)

    Google Scholar 

  40. Nakamura T (2020) Numbers of potential recreational anglers for the seas, inland waters, and inland fish species of Japan. Nippon Suisan Gakkaish, 19-00034 (in Japanese with English Abstract)

    Google Scholar 

  41. Nukazawa K, Kajiwara S, Saito T, Suzuki Y (2020) Preliminary assessment of the impacts of sediment sluicing events on stream insects in the Mimi River, Japan. Ecol Eng 145:105726

    Google Scholar 

  42. Øksendal B, Sulem A (2019) Applied stochastic control of jump diffusions. Springer, Cham

    MATH  Google Scholar 

  43. Olden JD, Naiman RJ (2010) Incorporating thermal regimes into environmental flows assessments: modifying dam operations to restore freshwater ecosystem integrity. Freshw Biol 55:86–107

    Google Scholar 

  44. Pham H (2002) Smooth solutions to optimal investment models with stochastic volatilities and portfolio constraints. Appl Math Optim 46:55–78

    MathSciNet  MATH  Google Scholar 

  45. Pham H (2009) Continuous-time stochastic control and optimization with financial applications. Springer, Berlin, Heidelberg

    MATH  Google Scholar 

  46. Pham H, Tankov P (2009) A coupled system of integrodifferential equations arising in liquidity risk model. Appl Math Optim 59:147

    MathSciNet  MATH  Google Scholar 

  47. Picarelli A, Reisinger C (2020) Probabilistic error analysis for some approximation schemes to optimal control problems. Syst Control Lett 137:104619

    MathSciNet  MATH  Google Scholar 

  48. Picarelli A, Vargiolu T (2020) Optimal management of pumped hydroelectric production with state constrained optimal control. J Econ Dyn Control 103940 (in press)

    Google Scholar 

  49. Rathan, S, L 1-type smoothness indicators based WENO scheme for Hamilton-Jacobi equations. Int J Numer Methods Fluids 92:1927–1947 (In press)

    Google Scholar 

  50. Reed WJ (1988) Optimal harvesting of a fishery subject to random catastrophic collapse. Math Med Biol 5:215–235

    MathSciNet  MATH  Google Scholar 

  51. Salgado AJ, Zhang W (2019) Finite element approximation of the Isaacs equation. ESAIM: Math Model Numer Anal 53:351–374

    Google Scholar 

  52. Schlomann BH (2018) Stationary moments, diffusion limits, and extinction times for logistic growth with random catastrophes. J Theor Biol 454:154–163

    MathSciNet  MATH  Google Scholar 

  53. Shen J, Yu H (2010) Efficient spectral sparse grid methods and applications to high-dimensional elliptic problems. SIAM J Sci Comput 32:3228–3250

    MathSciNet  MATH  Google Scholar 

  54. Smolar-Žvanut N, Mikoš M (2014) The impact of flow regulation by hydropower dams on the periphyton community in the Soča River, Slovenia. Hydrol Sci J 59(5):1032–1045. https://doi.org/10.1080/02626667.2013.834339

    Article  Google Scholar 

  55. Sohoulande CD, Stone K, Singh VP (2019) Quantifying the probabilistic divergences related to time-space scales for inferences in water resource management. Agric Water Manag 217:282–291

    Google Scholar 

  56. Song X, Zhong D, Wang G, Li X (2020) Stochastic evolution of hydraulic geometry relations in the lower Yellow River under environmental uncertainties. Int J Sedim Res 35:328–346

    Google Scholar 

  57. Stähly S, Franca MJ, Robinson CT, Schleiss AJ (2019) Sediment replenishment combined with an artificial flood improves river habitats downstream of a dam. Sci Rep 9:1–8

    Google Scholar 

  58. Steinfeld CMM, Sharma A, Mehrotra R, Kingsford RT (2020) The human dimension of water availability: influence of management rules on water supply for irrigated agriculture and the environment. J Hydrol 588:125009

    Google Scholar 

  59. Tago Y (2003) Number of Ayu caught by cast and tenkara nets at several depths in a concrete pond. Suisanzoshoku 51:225–226 (in Japanese with English Abstract)

    Google Scholar 

  60. Takai N, Kawabe K, Togura K, Kawasaki K, Kuwae T (2018) The seasonal trophic link between Great Cormorant Phalacrocorax carbo and ayu Plecoglossus altivelis altivelis reared for mass release. Ecol Res 33(5):935–948

    Google Scholar 

  61. Thomas LH (1949) Elliptic problems in linear difference equations over a network. Watson Sci. Comp. Lab. Rep, Columbia University, New York

    Google Scholar 

  62. Touzi N (2012) Optimal stochastic control, stochastic target problems, and backward SDE. Springer, New York

    MATH  Google Scholar 

  63. Wang H (2001) Some control problems with random intervention times. Adv Appl Probab 33:404–422

    MathSciNet  MATH  Google Scholar 

  64. Wang H, Li Y, Li J, An R, Zhang L, Chen M (2018) Influences of hydrodynamic conditions on the biomass of benthic diatoms in a natural stream. Ecol Ind 92:51–60

    Google Scholar 

  65. Ware A (2018) Reliability-constrained hydropower valuation. Energy Policy 118:633–641

    Google Scholar 

  66. Warin X (2014) Adaptive sparse grids for time dependent Hamilton-Jacobi-Bellman equations in stochastic control. arXiv preprint arXiv:1408.4267

  67. Wong M, Parker G (2006) Reanalysis and correction of bed-load relation of Meyer-Peter and Müller using their own database. J Hydraul Eng 132:1159–1168

    Google Scholar 

  68. Wu Y, Chen J (2013) Investigating the effects of point source and nonpoint source pollution on the water quality of the East River (Dongjiang) in South China. Ecol Ind 32:294–304

    Google Scholar 

  69. Yaegashi Y, Yoshioka H, Unami K, Fujihara M (2018) A singular stochastic control model for sustainable population management of the fish-eating waterfowl Phalacrocorax carbo. J Environ Manage 219:18–27

    Google Scholar 

  70. Yang B, Dou M, Xia R, Kuo YM, Li G, Shen L (2020) Effects of hydrological alteration on fish population structure and habitat in river system: a case study in the mid-downstream of the Hanjiang River in China. Glob Ecol Conserv 23:e01090

    Google Scholar 

  71. Yin GG, Zhu C (2009) Hybrid switching diffusions: properties and applications. Springer, New York, Dordrecht, Heidelberg, London

    MATH  Google Scholar 

  72. Yong J (2020) Stochastic optimal control-A concise introduction. Math Control Related Fields (in press). https://doi.org/10.3934/mcrf.2020027

  73. Yoshioka H (2019) A simplified stochastic optimization model for logistic dynamics with control-dependent carrying capacity. J Biol Dyn 13:148–176

    MathSciNet  MATH  Google Scholar 

  74. Yoshioka H (2020a) River environmental restoration based on random observations of a non-smooth stochastic dynamical system. arXiv preprint arXiv:2005.04817

  75. Yoshioka H (2020b) Mathematical modeling and computation of a dam-reservoir system balancing environmental management and hydropower generation. In: 2020 7th International Conference on Power and Energy Systems Engineering (CPESE 2020), September 26–29, 2020, Fukuoka Institute of Technology, Fukuoka, Japan (Accepted on May 15, 2020). Full paper, 4 p. (In press)

    Google Scholar 

  76. Yoshioka H, Yaegashi Y (2017) Stochastic optimization model of aquacultured fish for sale and ecological education. J Math Ind 7:1–23

    MathSciNet  Google Scholar 

  77. Yoshioka H, Yaegashi Y (2018) Mathematical analysis for management of released fish. Optimal Control Appl Methods 39:1141–1146

    MathSciNet  MATH  Google Scholar 

  78. Yoshioka H, Yaegashi Y (2018) Robust stochastic control modeling of dam discharge to suppress overgrowth of downstream harmful algae. Appl Stoch Model Bus Ind 34:338–354

    MathSciNet  MATH  Google Scholar 

  79. Yoshioka H, Yaegashi Y (2018) Stochastic differential game for management of non-renewable fishery resource under model ambiguity. J Biol Dyn 12:817–845

    MathSciNet  MATH  Google Scholar 

  80. Yoshioka H, Yaegashi Y, Yoshioka Y, Hamagami K, Fujihara M (2019) A primitive model for stochastic regular-impulse population control and its application to ecological problems. Adv Control Appl Eng Ind Syst 1:e16

    Google Scholar 

  81. Yoshioka H, Yaegashi Y, Yoshioka Y, Tsugihashi K (2019) A short note on analysis and application of a stochastic open-ended logistic growth model. Lett Biomath 6:67–77

    MathSciNet  MATH  Google Scholar 

  82. Yoshioka H, Yaegashi Y, Yoshioka Y, Hamagami K (2019) Hamilton–Jacobi–Bellman quasi-variational inequality arising in an environmental problem and its numerical discretization. Comput Math Appl 77:2182–2206

    MathSciNet  MATH  Google Scholar 

  83. Yoshioka H, Tanaka T, Aranishi F, Izumi T, Fujihara M (2019) Stochastic optimal switching model for migrating population dynamics. J Biol Dyn 13:706–732

    MathSciNet  MATH  Google Scholar 

  84. Yoshioka H, Hamagami K, Tujimura Y, Yoshioka Y, Yaegashi Y (2020) Chapter 3. Hydraulic control of the benthic alga Cladophora glomerata. In: Ayu and river environment in Hii River, Japan—research results from 2015 to 2020. Published by Laboratory of Mathematical Sciences for Environment and Ecology, Shimane University (in Japanese). Available at https://www.hiikawafish.jp/date/200300ayutokankyo.pdf

  85. Yoshioka H, Yaegashi Y (2020) Optimally controlling a non-smooth environmental system with random observation and execution delay. In: 18th International Conference of Numerical Analysis and Applied Mathematics (ICNAAM2020), September 17–23, Sheraton Hotel, Rhodes, Greece (in press)

    Google Scholar 

  86. Yoshioka H, Yoshioka Y (2019) Modeling stochastic operation of reservoir under ambiguity with an emphasis on river management. Optim Control Appl Methods 40(4):764–790

    MathSciNet  MATH  Google Scholar 

  87. Zhang YT, Zhao HK, Qian J (2006) High order fast sweeping methods for static Hamilton-Jacobi equations. J Sci Comput 29:25–56

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

JSPS KAKENHI 19H03073, Kurita Water and Environment Foundation Grant 19B018 and 20K004, and grants from MLIT Japan for surveys of the landlocked P. altivelis and management of seaweeds in Lake Shinji support this research. The author gratefully thanks to Dr. Srikanta Patnaik for his invitation to this volume.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hidekazu Yoshioka .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Yoshioka, H. (2021). Mathematical and Computational Approaches for Stochastic Control of River Environment and Ecology: From Fisheries Viewpoint. In: Patnaik, S., Tajeddini, K., Jain, V. (eds) Computational Management. Modeling and Optimization in Science and Technologies, vol 18. Springer, Cham. https://doi.org/10.1007/978-3-030-72929-5_2

Download citation

Publish with us

Policies and ethics