Markov Decision Processes With Their Applications (Hardcover)

List of Figures.- List of Tables.- Preface.- Acknowledgments.- 1. Introduction.- 2. Discrete-Time Markov Decision Processes: Total Reward.- 3. Discrete-Time Markov Decision Processes: Average Criterion.- 4. Continuous-Time Markov Decision Processes.- 5. Semi-Markov Decision Processes.- 6. Markov Decision Processes in Semi-Markov Environments.- 7. Optimal Control of Discrete Event Systems: I. 8. Optimal Control of Discrete Event Systems: II.- 9. Optimal Replacement Under Stochastic Environments.- 10. Optimal Allocation in Sequential Online Auctions.- Index.