Skip to main content
SpringerLink
Log in

Data-based composite control design with critic intelligence for a wastewater treatment platform

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

In this paper, by integrating neural network approximators, a data-based composite control technique is developed with critic learning implementation and wastewater treatment verification. The iterative adaptive critic framework is established involving dual heuristic dynamic programming (DHP), so as to obtain an intelligent optimal controller. Besides, a steady control input is computed with the help of the neural identifier. Then, by combining the DHP controller and the steady control input, an effective composite control strategy is derived and applied to the proposed wastewater treatment platform. Through conducting experiments, it is observed that the dissolved oxygen concentration and the nitrate level can be maintained at setting points successfully, which results in an intelligent wastewater treatment system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Alex J, Benedetti L, Copp J et al (2008) Benchmark simulation model no. 1 (BSM1), IWA Task group on benchmarking of control strategies for WWTPs, London

  • Al-Tamimi A, Lewis FL, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern Part B Cybern 38(4):943–949

    Article  Google Scholar 

  • Bo Y, Qiao J (2015) Heuristic dynamic programming using echo state network for multivariable tracking control of wastewater treatment process. Asian J Control 17(5):1654–1666

    Article  MathSciNet  MATH  Google Scholar 

  • Han H, Wu X, Qiao J (2019) A self-organizing sliding-mode controller for wastewater treatment processes. IEEE Trans Control Syst Technol 27(4):1480–1491

    Article  Google Scholar 

  • Iratni A, Chang NB (2019) Advances in control technologies for wastewater treatment processes: status, challenges, and perspectives. IEEE/CAA J Autom Sin 6(2):337–363

    Article  Google Scholar 

  • Jiang H, Zhang H (2018) Iterative ADP learning algorithms for discrete-time multi-player games. Artif Intell Rev 50(1):75–91

    Article  Google Scholar 

  • Li J, Chai T, Lewis FL, Fan J, Ding Z, Ding J (2018) Off-policy Q-learning: set-point design for optimizing dual-rate rougher flotation operational processes. IEEE Trans Ind Electron 65(5):4092–4102

    Article  Google Scholar 

  • Li S, Qiao J, Li W, Gu K (2018) Advanced decision and optimization control for wastewater treatment plants. Acta Autom Sin 44(12):2198–2209

    Google Scholar 

  • Liu D, Xu Y, Wei Q, Liu X (2018) Residential energy scheduling for variable weather solar energy based on adaptive dynamic programming. IEEE/CAA J Autom Sin 5(1):36–46

    Article  Google Scholar 

  • Luo B, Wu HN, Huang T (2018) Optimal output regulation for model-free quanser helicopter with multistep Q-learning. IEEE Trans Ind Electron 65(6):4953–4961

    Article  Google Scholar 

  • Qiao J, Wang Y, Chai W (2018) Optimal control based on iterative ADP for wastewater treatment process. J Beijing Univ Technol 44(2):200–206

    Google Scholar 

  • Wang D, Liu D, Wei Q, Zhao D, Jin N (2012) Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming. Automatica 48(8):1825–1832

    Article  MathSciNet  MATH  Google Scholar 

  • Wang D, He H, Liu D (2017) Adaptive critic nonlinear robust control: a survey. IEEE Trans Cybern 47(10):3429–3451

    Article  Google Scholar 

  • Werbos PJ (1992) Chapter 13, approximate dynamic programming for real-time control and neural modeling. In: White DA, Sofge DA (eds) Handbook of intelligent control: neural, fuzzy, and adaptive approaches. Van Nostrand Reinhold, New York

    Google Scholar 

  • Zhang H, Luo Y, Liu D (2009) Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints. IEEE Trans Neural Netw 20(9):1490–1503

    Article  Google Scholar 

  • Zhong X, Ni Z, He H (2016) A theoretical foundation of goal representation heuristic dynamic programming. IEEE Trans Neural Netw Learn Syst 27(12):2513–2525

    Article  Google Scholar 

  • Zhu Y, Zhao D (2018) Comprehensive comparison of online ADP algorithms for continuous-time optimal control. Artif Intell Rev 49(4):531–547

    Article  Google Scholar 

  • Zhu Y, Zhao D, Li X, Wang D (2019) Control-limited adaptive dynamic programming for multi-battery energy storage systems. IEEE Trans Smart Grid 10(4):4235–4244

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Ding Wang, Junfei Qiao & Yingbo Xie

  2. Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing, 100124, China

    Ding Wang, Junfei Qiao & Yingbo Xie

  3. Beijing Artificial Intelligence Institute, Beijing University of Technology, Beijing, 100124, China

    Ding Wang, Junfei Qiao & Yingbo Xie

  4. School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, 100083, China

    Mingming Ha

  5. Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada

    Jun Yan

Authors
  1. Ding Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingming Ha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junfei Qiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yingbo Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ding Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported in part by Beijing Natural Science Foundation under Grant JQ19013; in part by the Natural Sciences and Engineering Research Council of Canada (NSERC) under Grant DGECR-2018-00022; in part by the National Natural Science Foundation of China under Grant 61773373, Grant 61890930-5, and Grant 61533017; in part by the National Key Research and Development Project under Grant 2018YFC1900800-5; and in part by the Youth Innovation Promotion Association of the Chinese Academy of Sciences. No conflict of interest exits in this manuscript and it has been approved by all authors for publication.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, D., Ha, M., Qiao, J. et al. Data-based composite control design with critic intelligence for a wastewater treatment platform. Artif Intell Rev 53, 3773–3785 (2020). https://doi.org/10.1007/s10462-019-09778-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-019-09778-5

Keywords

Search

Navigation