# The Leading eBooks Store Online

## for Kindle Fire, Apple, Android, Nook, Kobo, PC, Mac, BlackBerry...

Most popular at the top

#### First Steps in Random Walks

Oxford University Press 2011; US$ 71.99The name "random walk" for a problem of a displacement of a point in a sequence of independent random steps was coined by Karl Pearson in 1905 in a question posed to readers of "Nature". The same year, a similar problem was formulated by Albert Einstein in one of his Annus Mirabilis works. Even earlier such a problem was posed by... more...

#### Inference in Hidden Markov Models

Springer-Verlag New York Inc 2006; US$ 199.00Gives a comprehensive treatment of inference for hidden Markov models, including both algorithms and statistical theory. This book is aimed at anybody with an interest in inference for stochastic processes, researchers, and practitioners in areas such as statistics, signal processing, communications engineering, finance, and more. more...

#### Cycle Representations of Markov Processes

Springer 2007; US$ 169.00Provides fresh insight into Markovian dependence via the cycle decompositions. This book presents an account of a class of stochastic processes known as cycle processes. It reveals interpretations of cycle representations such as homologic decompositions, orthogonality equations, Fourier series, semigroup equations, and disintegration of measures. more...

#### Markov Decision Processes and the Belief-Desire-Intention Model

Springer 2011; US$ 39.95In this work, we provide a treatment of the relationship between two models that have been widely used in the implementation of autonomous agents: the Belief DesireIntention (BDI) model and Markov Decision Processes (MDPs). We start with an informal description of the relationship, identifying the common features of the two approaches and the differences... more...

#### Dirichlet Forms and Symmetric Markov Processes

De Gruyter 1994; US$ 157.00Dirichlet Forms and Symmetric Markov Processes (De Gruyter Studies in Mathematics). more...

#### Markov Processes and Applications

Wiley 2008; US$ 96.00"This well-written book provides a clear and accessible treatment of the theory of discrete and continuous-time Markov chains, with an emphasis towards applications. The mathematical treatment is precise and rigorous without superfluous details, and the results are immediately illustrated in illuminating examples. This book will be extremely useful... more...

#### Markov Processes from K. Ito's Perspective (AM-155)

Princeton University Press 2003; US$ 72.50Kiyosi Itô's greatest contribution to probability theory may be his introduction of stochastic differential equations to explain the Kolmogorov-Feller theory of Markov processes. Starting with the geometric ideas that guided him, this book gives an account of Itô's program. The modern theory of Markov processes was initiated by A. N. Kolmogorov.... more...

#### Markov Chains

Wiley 2014; US$ 115.50Preface ix List of Figures xi Nomenclature xiii Introduction xv 1 First steps 1 1.1 Preliminaries 1 1.2 First properties of Markov chains 2 1.2.1 Markov chains, finite-dimensional marginals, and laws 2 1.2.2 Transition matrix action and matrix notation 5 1.2.3 Random recursion and simulation 9 1.2.4 Recursion for the instantaneous... more...

#### Markov Processes, Feller Semigroups and Evolution Equations

World Scientific Publishing Company 2010; US$ 204.00This book provides a systemic treatment of time-dependent strong Markov processes with values in a Polish space. It describes its generators and the link with stochastic differential equations in infinite dimensions. In a unifying way, where the square gradient operator is employed, new results for backward stochastic differential equations and long-time... more...