Constrained Markov Decision Processes : Stochastic Modeling - Eitan Altman

Constrained Markov Decision Processes

Stochastic Modeling

By: Eitan Altman

Hardcover | 30 March 1999 | Edition Number 1

At a Glance

Hardcover


RRP $378.00

$267.50

29%OFF

or 4 interest-free payments of $66.88 with

 or 

Available for Backorder. We will order this from our supplier however there isn't a current ETA.

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction.
The book is then divided into three sections that build upon each other.
The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques.
In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework.
The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Industry Reviews
"an outstanding addition to the MDPs literature and it complements." tstanding addition to the MDPs literature and it complements."

More in Probability & Statistics

Discovering Statistics Using IBM SPSS Statistics : (Paperback plus Ebook) 5ed - Andy Field
The Maths Book : Big Ideas Simply Explained - DK

RRP $42.99

$36.50

15%
OFF
On the Edge : The Art of Risking Everything - Nate Silver

RRP $36.99

$33.25

10%
OFF
Statistics for The Behavioral Sciences : 10th Edition - Frederick J. Gravetter
The Art of Statistics : Learning from Data - David Spiegelhalter
Statistics Using Stata : 3rd Edition - An Integrative Approach - Daphna  Harel
Statistics Without Tears : An Introduction For Non-Mathematicians - Derek Rowntree
Sampling : 3rd Edition - Design and Analysis - Sharon L. Lohr

RRP $145.00

$120.25

17%
OFF
Business Research Methods : 14th edition - Pamela S. Schindler

RRP $159.95

$142.35

11%
OFF
Introduction to Medical Statistics : 4th edition - Martin Bland

RRP $70.95

$62.35

12%
OFF
Multivariate Data Analysis : 8th Edition - Joseph F. Hair

RRP $169.95

$137.95

19%
OFF
Psychology Statistics For Dummies : For Dummies - Donncha Hanna

RRP $39.95

$35.25

12%
OFF
Introductory Econometrics for Finance : 4th edition - Chris  Brooks

RRP $101.95

$84.35

17%
OFF
Statistics in a Nutshell : In a Nutshell - Sarah Boslaugh

RRP $104.50

$46.90

55%
OFF
ISE Business Statistics and Analytics in Practice : 9th Edition - Bruce L. Bowerman