Cart
  • Free Shipping on all orders in Australia
  • Over 7 million books in stock
  • Proud to be B-Corp
  • We aim to be carbon neutral by 2022
  • Over 120,000 Trustpilot reviews
Item 1 of 0
Continuous-Time Markov Decision Processes By Xianping Guo

Continuous-Time Markov Decision Processes by Xianping Guo

Condition - New
$154.29
Only 2 left

Summary

This volume provides the first book entirely devoted to recent developments on the theory and applications of continuous-time Markov decision processes (MDPs). The MDPs presented here include most of the cases that arise in applications.

This book will be specially printed for your order, which means it may take a little longer to arrive (5 days). We do this to cut down on waste & to help protect our planet.

Continuous-Time Markov Decision Processes Summary

Continuous-Time Markov Decision Processes: Theory and Applications by Xianping Guo

Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. This volume provides a unified, systematic, self-contained presentation of recent developments on the theory and applications of continuous-time MDPs. The MDPs in this volume include most of the cases that arise in applications, because they allow unbounded transition and reward/cost rates. Much of the material appears for the first time in book form.

Continuous-Time Markov Decision Processes Reviews

From the reviews:

"The book consists of 12 chapters. ... this is the first monograph on continuous-time Markov decision process. ... This is an important book written by leading experts on a mathematically rich topic which has many applications to engineering, business, and biological problems. ... scholars and students interested in developing the theory of continuous-time Markov decision Processes or working on their applications should have this book." (E. A. Feinberg, Mathematical Reviews, Issue 2011 b)

About Xianping Guo

Onesimo Hernandez-Lerma received the Science and Arts National Award from the Government of MEXICO in 2001, an honorary doctorate from the University of Sonora in 2003, and the Scopus Prize from Elsevier in 2008. Xianping Guo received the He-Pan-Qing-Yi Best Paper Award from the 7th Word Congress on Intelligent Control and Automation in 2008.

Table of Contents

and Summary.- Continuous-Time Markov Decision Processes.- Average Optimality for Finite Models.- Discount Optimality for Nonnegative Costs.- Average Optimality for Nonnegative Costs.- Discount Optimality for Unbounded Rewards.- Average Optimality for Unbounded Rewards.- Average Optimality for Pathwise Rewards.- Advanced Optimality Criteria.- Variance Minimization.- Constrained Optimality for Discount Criteria.- Constrained Optimality for Average Criteria.

Additional information

NLS9783642260728
9783642260728
3642260721
Continuous-Time Markov Decision Processes: Theory and Applications by Xianping Guo
New
Paperback
Springer-Verlag Berlin and Heidelberg GmbH & Co. KG
2012-02-25
234
N/A
Book picture is for illustrative purposes only, actual binding, cover or edition may vary.
This is a new book - be the first to read this copy. With untouched pages and a perfect binding, your brand new copy is ready to be opened for the first time

Customer Reviews - Continuous-Time Markov Decision Processes