Markov Processes and Applications
Algorithms, Networks, Genome and Finance
Jean-François Le Gall, Professor at Université de Paris-Orsay, France.
Markov processes is the class of stochastic processes whose past and future are conditionally independent, given their present state. They constitute important models in many applied fields.
After an introduction to the Monte Carlo method, this book describes discrete time Markov chains, the Poisson process and continuous time Markov chains. It also presents numerous applications including Markov Chain Monte Carlo, Simulated Annealing, Hidden Markov Models, Annotation and Alignment of Genomic sequences, Control and Filtering, Phylogenetic tree reconstruction and Queuing networks. The last chapter is an introduction to stochastic calculus and mathematical finance.
- The Monte Carlo method, discrete time Markov chains, the Poisson process and continuous time jump Markov processes.
- An introduction to diffusion processes, mathematical finance and stochastic calculus.
- Applications of Markov processes to various fields, ranging from mathematical biology, to financial engineering and computer science.
- Numerous exercises and problems with solutions to most of them
323 pages; ISBN 9780470721865
, or download in
Title: Markov Processes and Applications
Author: Etienne Pardoux
The Foundations of Mathematics 2015 US$ 23.99 416 pages
A Gentle Introduction to Optimization 2014 US$ 32.00 284 pages