As is well known, Pontryagin's maximum principle and Bellman's dynamic programming are the two principal and most commonly used approaches in solving stochastic optimal control problems. * An interesting phenomenon one can observe from the literature is that these two approaches have been developed separately and independently. Since both methods are used to investigate the same problems, a natural question one will ask is the fol lowing: (Q) What is the relationship betwccn the maximum principlc and dy namic programming in stochastic optimal controls? There did exist some researches (prior to the 1980s) on the relationship between these two. Nevertheless, the results usually werestated in heuristic terms and proved under rather restrictive assumptions, which were not satisfied in most cases. In the statement of a Pontryagin-type maximum principle there is an adjoint equation, which is an ordinary differential equation (ODE) in the (finite-dimensional) deterministic case and a stochastic differential equation (SDE) in the stochastic case. The system consisting of the adjoint equa tion, the original state equation, and the maximum condition is referred to as an (extended) Hamiltonian system. On the other hand, in Bellman's dynamic programming, there is a partial differential equation (PDE), of first order in the (finite-dimensional) deterministic case and of second or der in the stochastic case. This is known as a Hamilton-Jacobi-Bellman (HJB) equation.

Uncertainty presents significant challenges in the reasoning about and controlling of complex dynamical systems. To address this challenge, numerous researchers are developing improved methods for stochastic analysis. This book presents a diverse collection of some of the latest research in this important area. In particular, this book gives an overview of some of the theoretical methods and tools for stochastic analysis, and it presents the applications of these methods to problems in systems theory, science, and economics.

Unabridged republication of the edition published by Academic Press, 1970.

​Stochastic Control and Filtering over Constrained Communication Networks presents up-to-date research developments and novel methodologies on stochastic control and filtering for networked systems under constrained communication networks. It provides a framework of optimal controller/filter design, resilient filter design, stability and performance analysis for the systems considered, subject to various kinds of communication constraints, including signal-to-noise constraints, bandwidth constraints, and packet drops. Several techniques are employed to develop the controllers and filters desired, including: recursive Riccati equations; matrix decomposition; optimal estimation theory; and mathematical optimization methods. Readers will benefit from the book’s new concepts, models and methodologies that have practical significance in control engineering and signal processing. Stochastic Control and Filtering over Constrained Communication Networks is a practical research reference for engineers dealing with networked control and filtering problems. It is also of interest to academics and students working in control and communication networks.

Unifies existing and emerging concepts concerning multi-objective control and stochastic control with engineering-oriented phenomena Establishes a unified theoretical framework for control and filtering problems for a class of discrete-time nonlinear stochastic systems with consideration to performance Includes case studies of several nonlinear stochastic systems Investigates the phenomena of incomplete information, including missing/degraded measurements, actuator failures and sensor saturations Considers both time-invariant systems and time-varying systems Exploits newly developed techniques to handle the emerging mathematical and computational challenges

This book contains an introduction to three topics in stochastic control: discrete time stochastic control, i. e. , stochastic dynamic programming (Chapter 1), piecewise - terministic control problems (Chapter 3), and control of Ito diffusions (Chapter 4). The chapters include treatments of optimal stopping problems. An Appendix - calls material from elementary probability theory and gives heuristic explanations of certain more advanced tools in probability theory. The book will hopefully be of interest to students in several ?elds: economics, engineering, operations research, ?nance, business, mathematics. In economics and business administration, graduate students should readily be able to read it, and the mathematical level can be suitable for advanced undergraduates in mathem- ics and science. The prerequisites for reading the book are only a calculus course and a course in elementary probability. (Certain technical comments may demand a slightly better background. ) As this book perhaps (and hopefully) will be read by readers with widely diff- ing backgrounds, some general advice may be useful: Don’t be put off if paragraphs, comments, or remarks contain material of a seemingly more technical nature that you don’t understand. Just skip such material and continue reading, it will surely not be needed in order to understand the main ideas and results. The presentation avoids the use of measure theory.

Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities presents a series of control and filtering approaches for stochastic systems with traditional and emerging engineering-oriented complexities. The book begins with an overview of the relevant background, motivation, and research problems, and then: Discusses the robust stability and stabilization problems for a class of stochastic time-delay interval systems with nonlinear disturbances Investigates the robust stabilization and H∞ control problems for a class of stochastic time-delay uncertain systems with Markovian switching and nonlinear disturbances Explores the H∞ state estimator and H∞ output feedback controller design issues for stochastic time-delay systems with nonlinear disturbances, sensor nonlinearities, and Markovian jumping parameters Analyzes the H∞ performance for a general class of nonlinear stochastic systems with time delays, where the addressed systems are described by general stochastic functional differential equations Studies the filtering problem for a class of discrete-time stochastic nonlinear time-delay systems with missing measurement and stochastic disturbances Uses gain-scheduling techniques to tackle the probability-dependent control and filtering problems for time-varying nonlinear systems with incomplete information Evaluates the filtering problem for a class of discrete-time stochastic nonlinear networked control systems with multiple random communication delays and random packet losses Examines the filtering problem for a class of nonlinear genetic regulatory networks with state-dependent stochastic disturbances and state delays Considers the H∞ state estimation problem for a class of discrete-time complex networks with probabilistic missing measurements and randomly occurring coupling delays Addresses the H∞ synchronization control problem for a class of dynamical networks with randomly varying nonlinearities Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities describes novel methodologies that can be applied extensively in lab simulations, field experiments, and real-world engineering practices. Thus, this text provides a valuable reference for researchers and professionals in the signal processing and control engineering communities.

This book treats stochastic control theory and its applications in management. The main numerical techniques necessary for such applications are presented. Several advanced topics leading to optimal processes are dismissed. The book also considers the theory of some stochastic control processes and several applications to illustrate the ideas.

Probability Methods for Approximations in Stochastic Control and for Elliptic Equations

The theoretical foundation for real options goes back to the mid 1980s and the development of a model that forms the basis for many current applications of real option theory. Over the last decade the theory has rapidly expanded and become enriched thanks to increasing research activity. Modern real option theory may be used for the valuation of entire companies as well as for particular investment projects in the presence of uncertainty. As such, the theory of real options can serve as a tool for more practically oriented decision making, providing management with strategies maximizing its capital market value. This book is devoted to examining a new framework for classifying real options from a management and a valuation perspective, giving the advantages and disadvantages of the real option approach. Impulse control theory and the theory of optimal stopping combined with methods of mathematical finance are used to construct arbitrarily complex real option models which can be solved numerically and which yield optimal capital market strategies and values. Various examples are given to demonstrate the potential of this framework. This work will benefit the financial community, companies, as well as academics in mathematical finance by providing an important extension of real option research from both a theoretical and practical point of view.