{"product_id":"9781908979667","title":"EXAMPLES IN MARKOV DECISION PROCESSES","description":"\u003cp\u003eThis invaluable book provides approximately eighty examples illustrating the theory of controlled discrete-time Markov processes. Except for applications of the theory to real-life problems like stock exchange, queues, gambling, optimal search etc, the main attention is paid to counter-intuitive, unexpected properties of optimization problems. Such examples illustrate the importance of conditions imposed in the theorems on Markov Decision Processes. Many of the examples are based upon examples published earlier in journal articles or textbooks while several other examples are new. The aim was to collect them together in one reference book which should be considered as a complement to existing monographs on Markov decision processes.\u003c\/p\u003e\u003cp\u003eThe book is self-contained and unified in presentation.\u003c\/p\u003e\u003cp\u003eThe main theoretical statements and constructions are provided, and particular examples can be read independently of others. \u003ci\u003eExamples in Markov Decision Processes\u003c\/i\u003e is an essential source of reference for mathematicians and all those who apply the optimal control theory to practical purposes. When studying or using mathematical methods, the researcher must understand what can happen if some of the conditions imposed in rigorous theorems are not satisfied. Many examples confirming the importance of such conditions were published in different journal articles which are often difficult to find. This book brings together examples based upon such sources, along with several new ones. In addition, it indicates the areas where Markov decision processes can be used. Active researchers can refer to this book on applicability of mathematical methods and theorems. It is also suitable reading for graduate and research students where they will better understand the theory.\u003c\/p\u003e\u003cb\u003eContents:\u003c\/b\u003e\u003cul\u003e\n\u003cli\u003eFinite-Horizon Models\u003c\/li\u003e\n\u003cli\u003eHomogeneous Infinite-Horizon Models: Expected Total Loss\u003c\/li\u003e\n\u003cli\u003eHomogeneous Infinite-Horizon Models: Discounted Loss\u003c\/li\u003e\n\u003cli\u003eHomogeneous Infinite-Horizon Models: Average Loss and Other Criteria\u003c\/li\u003e\n\u003c\/ul\u003e\u003cbr\u003e\u003cb\u003eReadership:\u003c\/b\u003e Advanced undergraduates, graduates and research students in applied mathematics; experts in Markov decision processes.\u003cbr\u003e","brand":"Imperial College Press","offers":[{"title":"Default Title","offer_id":47151371190512,"sku":"9781908979667","price":40.0,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0737\/7593\/9824\/files\/9781908979667_p0.jpg?v=1763624416","url":"https:\/\/shop-qa.barnesandnoble.com\/products\/9781908979667","provider":"Barnes \u0026 Noble (DEV)","version":"1.0","type":"link"}