Stochastic processes are found in probabilistic systems that evolve with time. Discrete stochastic processes change by only integer time steps (for some time scale), or are characterized by discrete occurrences at arbitrary times. Discrete Stochastic Processes helps the reader develop the understanding and intuition necessary to apply stochastic process theory in engineering, science and operations research. The book approaches the subject via many simple examples which build insight into the structure of stochastic processes and the general effect of these phenomena in real systems. The book presents mathematical ideas without recourse to measure theory, using only minimal mathematical analysis. In the proofs and explanations, clarity is favored over formal rigor, and simplicity over generality. Numerous examples are given to show how results fail to hold when all the conditions are not satisfied. Audience: An excellent textbook for a graduate level course in engineering and operations research. Also an invaluable reference for all those requiring a deeper understanding of the subject.

This unique text for beginning graduate students gives a self-contained introduction to the mathematical properties of stochastics and presents their applications to Markov processes, coding theory, population dynamics, and search engine design. The book is ideal for a newly designed course in an introduction to probability and information theory. Prerequisites include working knowledge of linear algebra, calculus, and probability theory. The first part of the text focuses on the rigorous theory of Markov processes on countable spaces (Markov chains) and provides the basis to developing solid probabilistic intuition without the need for a course in measure theory. The approach taken is gradual beginning with the case of discrete time and moving on to that of continuous time. The second part of this text is more applied; its core introduces various uses of convexity in probability and presents a nice treatment of entropy.

Optimal filtering applied to stationary and non-stationary signals provides the most efficient means of dealing with problems arising from the extraction of noise signals. Moreover, it is a fundamental feature in a range of applications, such as in navigation in aerospace and aeronautics, filter processing in the telecommunications industry, etc. This book provides a comprehensive overview of this area, discussing random and Gaussian vectors, outlining the results necessary for the creation of Wiener and adaptive filters used for stationary signals, as well as examining Kalman filters which are used in relation to non-stationary signals. Exercises with solutions feature in each chapter to demonstrate the practical application of these ideas using MATLAB.

Applied Probability and Stochastic Processes, Second Edition presents a self-contained introduction to elementary probability theory and stochastic processes with a special emphasis on their applications in science, engineering, finance, computer science, and operations research. It covers the theoretical foundations for modeling time-dependent random phenomena in these areas and illustrates applications through the analysis of numerous practical examples. The author draws on his 50 years of experience in the field to give your students a better understanding of probability theory and stochastic processes and enable them to use stochastic modeling in their work. New to the Second Edition Completely rewritten part on probability theory—now more than double in size New sections on time series analysis, random walks, branching processes, and spectral analysis of stationary stochastic processes Comprehensive numerical discussions of examples, which replace the more theoretically challenging sections Additional examples, exercises, and figures Presenting the material in a student-friendly, application-oriented manner, this non-measure theoretic text only assumes a mathematical maturity that applied science students acquire during their undergraduate studies in mathematics. Many exercises allow students to assess their understanding of the topics. In addition, the book occasionally describes connections between probabilistic concepts and corresponding statistical approaches to facilitate comprehension. Some important proofs and challenging examples and exercises are also included for more theoretically interested readers.

Engineers in all fields will appreciate a practical guide that combines several new effective MATLAB® problem-solving approaches and the very latest in discrete random signal processing and filtering. Numerous Useful Examples, Problems, and Solutions – An Extensive and Powerful Review Written for practicing engineers seeking to strengthen their practical grasp of random signal processing, Discrete Random Signal Processing and Filtering Primer with MATLAB provides the opportunity to doubly enhance their skills. The author, a leading expert in the field of electrical and computer engineering, offers a solid review of recent developments in discrete signal processing. The book also details the latest progress in the revolutionary MATLAB language. A Practical Self-Tutorial That Transcends Theory The author introduces an incremental discussion of signal processing and filtering, and presents several new methods that can be used for a more dynamic analysis of random digital signals with both linear and non-linear filtering. Ideal as a self-tutorial, this book includes numerous examples and functions, which can be used to select parameters, perform simulations, and analyze results. This concise guide encourages readers to use MATLAB functions – and those new ones introduced as Book MATLAB Functions – to substitute many different combinations of parameters, giving them a firm grasp of how much each parameter affects results. Much more than a simple review of theory, this book emphasizes problem solving and result analysis, enabling readers to take a hands-on approach to advance their own understanding of MATLAB and the way it is used within signal processing and filtering.

Additive and multiplicative noise in the information signal can significantly limit the potential of complex signal processing systems, especially when those systems use signals with complex phase structure. During the last few years this problem has been the focus of much research, and its solution could lead to profound improvements in applications of complex signals and coherent signal processing. Signal Processing Noise sets forth a generalized approach to signal processing in multiplicative and additive noise that represents a remarkable advance in signal processing and detection theory. This approach extends the boundaries of the noise immunity set by classical and modern signal processing theories, and systems constructed on this basis achieve better detection performance than that of systems currently in use. Featuring the results of the author's own research, the book is filled with examples and applications, and each chapter contains an analysis of recent observations obtained by computer modelling and experiments. Tables and illustrations clearly show the superiority of the generalized approach over both classical and modern approaches to signal processing noise. Addressing a fundamental problem in complex signal processing systems, this book offers not only theoretical development, but practical recommendations for raising noise immunity in a wide range of applications.

Discrete stochastic models are tools that allow us to understand, control, and optimize engineering systems and processes. This book provides real-life examples and illustrations of models in reliability engineering and statistical quality control and establishes a connection between the theoretical framework and their engineering applications. The book describes discrete stochastic models along with real-life examples and explores not only well-known models, but also comparatively lesser known ones. It includes definitions, concepts, and methods with a clear understanding of their use in reliability engineering and statistical quality control fields. Also covered are the recent advances and established connections between the theoretical framework of discrete stochastic models and their engineering applications. An ideal reference for researchers in academia and graduate students working in the fields of operations research, reliability engineering, quality control, and probability and statistics.