ISBN:
0444898573
Content:
This chapter explores the numerical methods for solving dynamic programming (DP) problems. The DP framework has been extensively used in economics because it is sufficiently rich to model almost any problem involving sequential decision making over time and under uncertainty. The chapter focuses on continuous Markov decision processes (MDPs) because these problems arise frequently in economic applications. Although, complexity theory suggests a number of useful algorithms, the theory has relatively little to say about important practical issues, such as determining the point at which various exponential-time algorithms such as Chebyshev approximation methods start to blow up, making it optimal to switch to polynomial-time algorithms. In future work, it will be essential to provide numerical comparisons of a broader range of methods over a broader range of test problems, including problems of moderate to high dimensionality.
In:
Handbook of computational economics, Amsterdam : Elsevier, 1996, (1996), Seite 619-729, 0444898573
In:
9780444898579
In:
year:1996
In:
pages:619-729
Language:
English
DOI:
10.1016/S1574-0021(96)01016-7
URL:
Volltext
(Deutschlandweit zugänglich)
