Competitive Markov Decision Processes

'Stochastic Games' have been studied by mathematicians, operations researchers, electrical engineers, and economists since the 1950s; the simpler single-controller, noncompetitive version of these models evolved separately under the name of 'Markov Decision Processes'. This book is devoted to a unified treatment of both subjects under the general heading of 'Competitive Markov Decision Processes'. It examines these processes from the standpoints of modeling and of optimization, providing newcomers to the field with an accessible account of algorithms, theory, and applications, while also supplying specialists with a comprehensive survey of recent developments.