Introduction to Markov Decision Processes
By Martin L. Puterman and Timothy C. Y. Chan
We are currently writing a book that will be an accessible and up to date introduction to Markov decision processes. Our target audience includes undergraduate students, graduate students and self-directed learners looking for a structured introduction that covers foundations, algorithms, and applications.
Drafts of certain chapters will be posted here as they become available. We welcome all feedback and suggestions.