Introduction to the Numerical Solution of Markov Chains

Offers a systematic and detailed treatment of the numerical solution of Markov chains. This book explores various aspects of numerically computing solutions of Markov chains, especially when the state is huge. It examines many different numerical computing methods - direct, single-and multi-vector iterative, and projection methods.