Monotone optimal control for a class of Markov decision processes

This paper provides a unified framework to study monotone optimal control for a class of Markov decision processes through D-multimodularity. We demonstrate that each system in this class can be classified as either a substitution-type or a complement-type system according to the possible transition...

Full description

Saved in:
Bibliographic Details
Main Authors: Li, Michael Z. F., Zhuang, Weifen
Other Authors: Nanyang Business School
Format: Article
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/102555
http://hdl.handle.net/10220/11277
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-102555
record_format dspace
spelling sg-ntu-dr.10356-1025552023-05-19T06:44:42Z Monotone optimal control for a class of Markov decision processes Li, Michael Z. F. Zhuang, Weifen Nanyang Business School DRNTU::Business This paper provides a unified framework to study monotone optimal control for a class of Markov decision processes through D-multimodularity. We demonstrate that each system in this class can be classified as either a substitution-type or a complement-type system according to the possible transition set, which can be used as a classification mechanism that integrates a variety of models in the literature. We develop a generic proof of the structural properties of both types of system. In particular, we show that D-multimodularity is a generally sufficient condition for monotone optimal control of different types of system in this class. With this unified theory, there is no need to pursue each problem ad hoc and the structural properties of this class of MDPs follow with ease. 2013-07-12T03:01:06Z 2019-12-06T20:56:53Z 2013-07-12T03:01:06Z 2019-12-06T20:56:53Z 2011 2011 Journal Article https://hdl.handle.net/10356/102555 http://hdl.handle.net/10220/11277 10.1016/j.ejor.2011.09.021 en European journal of operational research © 2011 Elsevier B.V.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Business
spellingShingle DRNTU::Business
Li, Michael Z. F.
Zhuang, Weifen
Monotone optimal control for a class of Markov decision processes
description This paper provides a unified framework to study monotone optimal control for a class of Markov decision processes through D-multimodularity. We demonstrate that each system in this class can be classified as either a substitution-type or a complement-type system according to the possible transition set, which can be used as a classification mechanism that integrates a variety of models in the literature. We develop a generic proof of the structural properties of both types of system. In particular, we show that D-multimodularity is a generally sufficient condition for monotone optimal control of different types of system in this class. With this unified theory, there is no need to pursue each problem ad hoc and the structural properties of this class of MDPs follow with ease.
author2 Nanyang Business School
author_facet Nanyang Business School
Li, Michael Z. F.
Zhuang, Weifen
format Article
author Li, Michael Z. F.
Zhuang, Weifen
author_sort Li, Michael Z. F.
title Monotone optimal control for a class of Markov decision processes
title_short Monotone optimal control for a class of Markov decision processes
title_full Monotone optimal control for a class of Markov decision processes
title_fullStr Monotone optimal control for a class of Markov decision processes
title_full_unstemmed Monotone optimal control for a class of Markov decision processes
title_sort monotone optimal control for a class of markov decision processes
publishDate 2013
url https://hdl.handle.net/10356/102555
http://hdl.handle.net/10220/11277
_version_ 1770564560660463616