Stochastic control plays an important role in many scientific and applied disciplines including communications, engineering, medicine, finance and many others. It is one of the effective methods being used to find optimal decision-making strategies in applications. The book provides a collection of outstanding investigations in various aspects of stochastic systems and their behavior. The book provides a self-contained treatment on practical aspects of stochastic modeling and calculus including applications drawn from engineering, statistics, and computer science. Readers should be familiar with basic probability theory and have a working knowledge of stochastic calculus. PhD students and researchers in stochastic control will find this book useful.