This volume provides the first book entirely devoted to recent developments on the theory and applications of continuous-time Markov decision processes (MDPs). The MDPs presented here include most of the cases that arise in applications.
From the reviews:
“The book consists of 12 chapters. ... this is the first monograph on continuous-time Markov decision process. ... This is an important book written by leading experts on a mathematically rich topic which has many applications to engineering, business, and biological problems. ... scholars and students interested in developing the theory of continuous-time Markov decision Processes or working on their applications should have this book.” (E. A. Feinberg, Mathematical Reviews, Issue 2011 b)