Metrics
7 Record Views
Book chapter
Computational Intelligence in Uncertainty Quantification for Learning Control and Differential Games
Handbook of Reinforcement Learning and Control, pp.385-418
Studies in Systems, Decision and Control, Springer International Publishing
2021
Abstract
Multi-dimensional uncertainties often modulate modern system dynamics in a complicated fashion. They lead to challenges for real-time control, considering the significant computation load needed to evaluate them in real-time decision processes. This chapter describes the use of computationally effective uncertainty evaluation methods for adaptive optimal control, including learning control and differential games. Two uncertainty evaluation methods are described, the multivariate probabilistic collocation method (MPCM) and its extension the MPCM-OFFD that integrates the MPCM with the orthogonal fractional factorial design (OFFD) to break the curse of dimensionality. These scalable uncertainty evaluation methods are then developed for reinforcement learning (RL)-based adaptive optimal control. Stochastic differential games, including the two-player zero-sum and multi-player nonzero-sum games, are formulated and investigated. Nash equilibrium solutions for these games are found in real time using the MPCM-based on-policy/off-policy RL methods. Real-world applications on broad-band long-distance aerial networking and strategic air traffic management demonstrate the practical use of MPCM- and MPCM-OFFD-based learning control for uncertain systems.
Related links
Details
- Title
- Computational Intelligence in Uncertainty Quantification for Learning Control and Differential Games
- Publication Details
- Handbook of Reinforcement Learning and Control, pp.385-418
- Resource Type
- Book chapter
- Publisher
- Springer International Publishing; Cham
- Series
- Studies in Systems, Decision and Control
- Number of pages
- 34
- Copyright
- © Springer Nature Switzerland AG 2021
- Identifiers
- 99381512425906600
- Academic Unit
- Intelligent Systems and Robotics; Hal Marcus College of Science and Engineering
- Language
- English