Abstract
Approximate dynamic programming (ADP or RLADP) includes a wide variety of general methods to solve for optimal decision and control in the face of complexity, nonlinearity, stochasticity, and/or partial observability. This entry first reviews methods and a few key applications across decision and control engineering (e.g., vehicle and logistics control), computer science (e.g., AlphaGo), operations research, and connections to economics, neuropsychology, and animal behavior. Then it summarizes a sixfold mathematical taxonomy of methods in use today, with pointers to the future.
Paul J. Werbos has retired.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Bibliography
Lewis FL, Liu D (eds), (2013) Reinforcement learning and approximate dynamic programming for feedback control, vol 17. Wiley (IEEE Series), New York
Werbos PJ (2005) Backwards differentiation in AD and neural nets: past links and new opportunities. In: Bucker M, Corliss G, Hovland P, Naumann, Norris B (eds) Automatic differentiation: applications, theory and implementations. Springer, New York
Werbos PJ (2014) Werbos, from ADP to the brain: foundations, roadmap, challenges and research priorities. In: Proceedings of the international joint conference on neural networks 2014. IEEE, New Jersey. https://arxiv.org/abs/1404.0554
Werbos PJ, Davis JJ, (2016) Regular cycles of forward and backward signal propagation in prefrontal cortex and in consciousness. Front Syst Neurosci 10:97. https://doi.org/10.3389/fnsys.2016.00097
White DA, Sofge DA (eds) (1992) Handbook of intelligent control: neural, fuzzy, and adaptive approaches. Van Nostrand Reinhold, New York
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this entry
Cite this entry
Werbos, P.J. (2021). Approximate Dynamic Programming (ADP). In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, Cham. https://doi.org/10.1007/978-3-030-44184-5_100096
Download citation
DOI: https://doi.org/10.1007/978-3-030-44184-5_100096
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-44183-8
Online ISBN: 978-3-030-44184-5
eBook Packages: Intelligent Technologies and RoboticsReference Module Computer Science and Engineering