Partially observed Markov decision processes with binomial observations

Tal Ben-Zvi; Abraham Grosfeld-Nir

doi:10.1016/j.orl.2013.01.005

Partially observed Markov decision processes with binomial observations

Tal Ben-Zvi
, Abraham Grosfeld-Nir

School of Business

Academic College of Tel-Aviv - Yaffo

Research output: Contribution to journal › Article › peer-review

6 Scopus citations

Abstract

We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear equations.

Original language	English
Pages (from-to)	201-206
Number of pages	6
Journal	Operations Research Letters
Volume	41
Issue number	2
DOIs	https://doi.org/10.1016/j.orl.2013.01.005
State	Published - Mar 2013

Keywords

Binomial yield
Control limit
POMDP

Access to Document

10.1016/j.orl.2013.01.005

Cite this

@article{30471ff530364875b3116ea119531813,

title = "Partially observed Markov decision processes with binomial observations",

abstract = "We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear equations.",

keywords = "Binomial yield, Control limit, POMDP",

author = "Tal Ben-Zvi and Abraham Grosfeld-Nir",

year = "2013",

month = mar,

doi = "10.1016/j.orl.2013.01.005",

language = "English",

volume = "41",

pages = "201--206",

number = "2",

}

TY - JOUR

T1 - Partially observed Markov decision processes with binomial observations

AU - Ben-Zvi, Tal

AU - Grosfeld-Nir, Abraham

PY - 2013/3

Y1 - 2013/3

N2 - We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear equations.

AB - We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear equations.

KW - Binomial yield

KW - Control limit

KW - POMDP

UR - https://www.scopus.com/pages/publications/84873030423

UR - https://www.scopus.com/pages/publications/84873030423#tab=citedBy

U2 - 10.1016/j.orl.2013.01.005

DO - 10.1016/j.orl.2013.01.005

M3 - Article

AN - SCOPUS:84873030423

SN - 0167-6377

VL - 41

SP - 201

EP - 206

JO - Operations Research Letters

JF - Operations Research Letters

IS - 2

ER -

Partially observed Markov decision processes with binomial observations

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this