This book treats stochastic control theory and its applications in management. The main numerical techniques necessary for such applications are presented. Several advanced topics leading to optimal processes are dismissed. The book also considers the theory of some stochastic control processes and several applications to illustrate the ideas.

Decision Criteria and Optimal Inventory Processes provides a theoretical and practical introduction to decision criteria and inventory processes. Inventory theory is presented by focusing on the analysis and processes underlying decision criteria. Included are many state-of-the-art criterion models as background material. These models are extended to the authors' newly developed fuzzy criterion models which constitute a general framework for the study of stochastic inventory models with special focus on the real world inventory theoretic reservoir operations problems. The applications of fuzzy criterion dynamic programming models are illustrated by reservoir operations including the integrated network of reservoir operation and the open inventory network problems. An interesting feature of this book is the special attention it pays to the analysis of some theoretical and applied aspects of fuzzy criteria and dynamic fuzzy criterion models, thus opening up a new way of injecting the much-needed type of non-cost, intuitive, and easy-to-use methods into multi-stage inventory processes. This is accomplished by constructing and optimizing the fuzzy criterion models developed for inventory processes. Practitioners in operations research, management science, and engineering will find numerous new ideas and strategies for modeling real world multi- stage inventory problems, and researchers and applied mathematicians will find this work a stimulating and useful reference.

​There are several techniques to study noncooperative dynamic games, such as dynamic programming and the maximum principle (also called the Lagrange method). It turns out, however, that one way to characterize dynamic potential games requires to analyze inverse optimal control problems, and it is here where the Euler equation approach comes in because it is particularly well–suited to solve inverse problems. Despite the importance of dynamic potential games, there is no systematic study about them. This monograph is the first attempt to provide a systematic, self–contained presentation of stochastic dynamic potential games.

This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include various aspects of dynamic programming, approximation algorithms, and infinite-dimensional linear programming. In all, the work comprises 18 carefully selected papers written by experts in their respective fields. Optimization, Control, and Applications of Stochastic Systems will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and dynamic games.

This book presents the latest findings on stochastic dynamic programming models and on solving optimal control problems in networks. It includes the authors’ new findings on determining the optimal solution of discrete optimal control problems in networks and on solving game variants of Markov decision problems in the context of computational networks. First, the book studies the finite state space of Markov processes and reviews the existing methods and algorithms for determining the main characteristics in Markov chains, before proposing new approaches based on dynamic programming and combinatorial methods. Chapter two is dedicated to infinite horizon stochastic discrete optimal control models and Markov decision problems with average and expected total discounted optimization criteria, while Chapter three develops a special game-theoretical approach to Markov decision processes and stochastic discrete optimal control problems. In closing, the book’s final chapter is devoted to finite horizon stochastic control problems and Markov decision processes. The algorithms developed represent a valuable contribution to the important field of computational network theory.

This book presents state-of-the-art solution methods and applications of stochastic optimal control. It is a collection of extended papers discussed at the traditional Liverpool workshop on controlled stochastic processes with participants from both the east and the west. New problems are formulated, and progresses of ongoing research are reported. Topics covered in this book include theoretical results and numerical methods for Markov and semi-Markov decision processes, optimal stopping of Markov processes, stochastic games, problems with partial information, optimal filtering, robust control, Q-learning, and self-organizing algorithms. Real-life case studies and applications, e.g., queueing systems, forest management, control of water resources, marketing science, and healthcare, are presented. Scientific researchers and postgraduate students interested in stochastic optimal control,- as well as practitioners will find this book appealing and a valuable reference. ​