# The Leading eBooks Store Online

## 3,794,961 members ⚫ 1,236,034 ebooks

Most popular at the top

#### Examples in Markov Decision Processes

World Scientific Publishing Company 2012; US$ 79.00 US$ 71.89This invaluable book provides approximately eighty examples illustrating the theory of controlled discrete-time Markov processes. Except for applications of the theory to real-life problems like stock exchange, queues, gambling, optimal search etc, the main attention is paid to counter-intuitive, unexpected properties of optimization problems. Such... more...

#### Brownian Motion, Hardy Spaces and Bounded Mean Oscillation

Cambridge University Press 1977; US$ 44.00An exposition of research on the martingale and analytic inequalities associated with Hardy spaces and functions of bounded mean oscillation (BMO). more...

#### Lectures on Stochastic Analysis: Diffusion Theory

Cambridge University Press 1987; US$ 33.00This book is based on a course given at Massachusetts Institute of Technology. more...

#### Random Walk in Random and Non-Random Environments

World Scientific Publishing Company 2013; US$ 78.00 US$ 70.98The simplest mathematical model of the Brownian motion of physics is the simple, symmetric random walk. This book collects and compares current results — mostly strong theorems which describe the properties of a random walk. The modern problems of the limit theorems of probability theory are treated in the simple case of coin tossing. Taking... more...

#### Matrix-Analytic Methods

World Scientific Publishing Company 2002; US$ 158.00 US$ 143.78Matrix-analytic methods are fundamental to the analysis of a family of Markov processes rich in structure and of wide applicability. They are extensively used in the modelling and performance analysis of computer systems, telecommunication networks, network protocols and many other stochastic systems of current commercial and engineering interest.This... more...

#### Markov Chains

Cambridge University Press 1998; US$ 48.00For students in pure and applied probability; lots of applications, fairly self-contained. more...

#### The Dynamics of Discrete Populations and Series of Events

CRC Press 2014; US$ 88.00Discrete phenomena are an important aspect of various complex systems, acting both as underlying driving mechanisms and as manifestations of diverse behaviours. However, the characterisation of these discrete phenomena requires models that go beyond those featured in existing books. Largely concerned with mathematical models used to describe time-varying... more...

#### Markov Processes from K. Ito's Perspective (AM-155)

Princeton University Press 2003; US$ 85.00 US$ 77.35Kiyosi Itô's greatest contribution to probability theory may be his introduction of stochastic differential equations to explain the Kolmogorov-Feller theory of Markov processes. Starting with the geometric ideas that guided him, this book gives an account of Itô's program. The modern theory of Markov processes was initiated by A. N. Kolmogorov.... more...

#### Semigroups, Boundary Value Problems and Markov Processes

Springer Berlin Heidelberg 2014; US$ 95.12A careful and accessible exposition of functional analytic methods in stochastic analysis is provided in this book. It focuses on the interrelationship between three subjects in analysis: Markov processes, semi groups and elliptic boundary value problems. The author studies a general class of elliptic boundary value problems for second-order, Waldenfels... more...

#### Theory of Markov Processes

Elsevier Science 2014; US$ 72.95Theory of Markov Processes provides information pertinent to the logical foundations of the theory of Markov random processes. This book discusses the properties of the trajectories of Markov processes and their infinitesimal operators. Organized into six chapters, this book begins with an overview of the necessary concepts and theorems from measure... more...