Sensitivity-analysis in discounted Markovian decision problems

A. Hordijk*, R. Dekker, L. C.M. Kallenberg

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

15 Citations (Scopus)


This paper deals with a finite-state, finiteaction discrete-time Markov decision model. A linear programming procedure is developed for the computation of optimal policies over the entire range of the discount factor. Furthermore, a procedure is presented for the computation of a Blackwell optimal policy.

Original languageEnglish
Pages (from-to)143-151
Number of pages9
JournalOR Spektrum
Issue number3
Publication statusPublished - Sept 1985


Dive into the research topics of 'Sensitivity-analysis in discounted Markovian decision problems'. Together they form a unique fingerprint.

Cite this