Robust Adaptive Dynamic Programming - Yu Jiang

. .

Résumé :
.

Biographie:
.

Sommaire:
ABOUT THE AUTHORS xi PREFACE AND ACKNOWLEDGMENTS xiii ACRONYMS xvii GLOSSARY xix 1 INTRODUCTION 1 1.1 From RL to RADP 1 1.2 Summary of Each Chapter 5 References 6 2 ADAPTIVE DYNAMIC PROGRAMMING FOR UNCERTAIN LINEAR SYSTEMS 11 2.1 Problem Formulation and Preliminaries 11 2.2 Online Policy Iteration 14 2.3 Learning Algorithms 16 2.4 Applications 24 2.5 Notes 29 References 30 3 SEMI-GLOBAL ADAPTIVE DYNAMIC PROGRAMMING 35 3.1 Problem Formulation and Preliminaries 35 3.2 Semi-Global Online Policy Iteration 38 3.3 Application 43 3.4 Notes 46 References 46 4 GLOBAL ADAPTIVE DYNAMIC PROGRAMMING FOR NONLINEAR POLYNOMIAL SYSTEMS 49 4.1 Problem Formulation and Preliminaries 49 4.2 Relaxed HJB Equation and Suboptimal Control 52 4.3 SOS-Based Policy Iteration for Polynomial Systems 55 4.4 Global ADP for Uncertain Polynomial Systems 59 4.5 Extension for Nonlinear Non-Polynomial Systems 64 4.6 Applications 70 4.7 Notes 81 References 81 5 ROBUST ADAPTIVE DYNAMIC PROGRAMMING 85 5.1 RADP for Partially Linear Composite Systems 86 5.2 RADP for Nonlinear Systems 97 5.3 Applications 103 5.4 Notes 109 References 110 6 ROBUST ADAPTIVE DYNAMIC PROGRAMMING FOR LARGE-SCALE SYSTEMS 113 6.1 Stability and Optimality for Large-Scale Systems 113 6.2 RADP for Large-Scale Systems 122 6.3 Extension for Systems with Unmatched Dynamic Uncertainties 124 6.4 Application to a Ten-Machine Power System 128 6.5 Notes 132 References 133 7 ROBUST ADAPTIVE DYNAMIC PROGRAMMING AS A THEORY OF SENSORIMOTOR CONTROL 137 7.1 ADP for Continuous-Time Stochastic Systems 138 7.2 RADP for Continuous-Time Stochastic Systems 143 7.3 Numerical Results: ADP-Based Sensorimotor Control 153 7.4 Numerical Results: RADP-Based Sensorimotor Control 165 7.5 Discussion 167 7.6 Notes 172 References 173 A BASIC CONCEPTS IN NONLINEAR SYSTEMS 177 A.1 Lyapunov Stability 177 A.2 ISS and the Small-Gain Theorem 178 B SEMIDEFINITE PROGRAMMING AND SUM-OF-SQUARES PROGRAMMING 181 B.1 SDP and SOSP 181 C PROOFS 183 C.1 Proof of Theorem 3.1.4 183 C.2 Proof of Theorem 3.2.3 186 References 188 INDEX 191