Unabridged republication of the edition published by Academic Press, 1970.

This text for upper-level undergraduates and graduate students explores stochastic control theory in terms of analysis, parametric optimization, and optimal stochastic control. Limited to linear systems with quadratic criteria, it covers discrete time as well as continuous time systems. The first three chapters provide motivation and background material on stochastic processes, followed by an analysis of dynamical systems with inputs of stochastic processes. A simple version of the problem of optimal control of stochastic systems is discussed, along with an example of an industrial application of this theory. Subsequent discussions cover filtering and prediction theory as well as the general stochastic control problem for linear systems with quadratic criteria. Each chapter begins with the discrete time version of a problem and progresses to a more challenging continuous time version of the same problem. Prerequisites include courses in analysis and probability theory in addition to a course in dynamical systems that covers frequency response and the state-space approach for continuous time and discrete time systems.

This volume builds upon the foundations set in Volumes 1 and 2. Chapter 13 introduces the basic concepts of stochastic control and dynamic programming as the fundamental means of synthesizing optimal stochastic control laws.

This book treats stochastic control theory and its applications in management. The main numerical techniques necessary for such applications are presented. Several advanced topics leading to optimal processes are dismissed. The book also considers the theory of some stochastic control processes and several applications to illustrate the ideas.

Uncertainty presents significant challenges in the reasoning about and controlling of complex dynamical systems. To address this challenge, numerous researchers are developing improved methods for stochastic analysis. This book presents a diverse collection of some of the latest research in this important area. In particular, this book gives an overview of some of the theoretical methods and tools for stochastic analysis, and it presents the applications of these methods to problems in systems theory, science, and economics.

This is the first book to systematically present control theory for stochastic distributed parameter systems, a comparatively new branch of mathematical control theory. The new phenomena and difficulties arising in the study of controllability and optimal control problems for this type of system are explained in detail. Interestingly enough, one has to develop new mathematical tools to solve some problems in this field, such as the global Carleman estimate for stochastic partial differential equations and the stochastic transposition method for backward stochastic evolution equations. In a certain sense, the stochastic distributed parameter control system is the most general control system in the context of classical physics. Accordingly, studying this field may also yield valuable insights into quantum control systems. A basic grasp of functional analysis, partial differential equations, and control theory for deterministic systems is the only prerequisite for reading this book.

Probability Methods for Approximations in Stochastic Control and for Elliptic Equations

Unifies existing and emerging concepts concerning multi-objective control and stochastic control with engineering-oriented phenomena Establishes a unified theoretical framework for control and filtering problems for a class of discrete-time nonlinear stochastic systems with consideration to performance Includes case studies of several nonlinear stochastic systems Investigates the phenomena of incomplete information, including missing/degraded measurements, actuator failures and sensor saturations Considers both time-invariant systems and time-varying systems Exploits newly developed techniques to handle the emerging mathematical and computational challenges

Linear Stochastic Control Systems presents a thorough description of the mathematical theory and fundamental principles of linear stochastic control systems. Both continuous-time and discrete-time systems are thoroughly covered. Reviews of the modern probability and random processes theories and the Itô stochastic differential equations are provided. Discrete-time stochastic systems theory, optimal estimation and Kalman filtering, and optimal stochastic control theory are studied in detail. A modern treatment of these same topics for continuous-time stochastic control systems is included. The text is written in an easy-to-understand style, and the reader needs only to have a background of elementary real analysis and linear deterministic systems theory to comprehend the subject matter. This graduate textbook is also suitable for self-study, professional training, and as a handy research reference. Linear Stochastic Control Systems is self-contained and provides a step-by-step development of the theory, with many illustrative examples, exercises, and engineering applications.

Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities presents a series of control and filtering approaches for stochastic systems with traditional and emerging engineering-oriented complexities. The book begins with an overview of the relevant background, motivation, and research problems, and then: Discusses the robust stability and stabilization problems for a class of stochastic time-delay interval systems with nonlinear disturbances Investigates the robust stabilization and H∞ control problems for a class of stochastic time-delay uncertain systems with Markovian switching and nonlinear disturbances Explores the H∞ state estimator and H∞ output feedback controller design issues for stochastic time-delay systems with nonlinear disturbances, sensor nonlinearities, and Markovian jumping parameters Analyzes the H∞ performance for a general class of nonlinear stochastic systems with time delays, where the addressed systems are described by general stochastic functional differential equations Studies the filtering problem for a class of discrete-time stochastic nonlinear time-delay systems with missing measurement and stochastic disturbances Uses gain-scheduling techniques to tackle the probability-dependent control and filtering problems for time-varying nonlinear systems with incomplete information Evaluates the filtering problem for a class of discrete-time stochastic nonlinear networked control systems with multiple random communication delays and random packet losses Examines the filtering problem for a class of nonlinear genetic regulatory networks with state-dependent stochastic disturbances and state delays Considers the H∞ state estimation problem for a class of discrete-time complex networks with probabilistic missing measurements and randomly occurring coupling delays Addresses the H∞ synchronization control problem for a class of dynamical networks with randomly varying nonlinearities Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities describes novel methodologies that can be applied extensively in lab simulations, field experiments, and real-world engineering practices. Thus, this text provides a valuable reference for researchers and professionals in the signal processing and control engineering communities.