Markov Chains and Decision Processes for Engineers and Managers

Presents an introduction to finite Markov chains and Markov decision processes, with applications in engineering and management. This book introduces discrete-time, finite-state Markov chains, and Markov decision processes. It describes both algorithms and applications, enabling students to understand the logical basis for the algorithms.