Approximate solutions for large-scale piecewise deterministic control systems arising in manufacturing flow control models - Archive ouverte HAL Access content directly
Journal Articles IEEE Transactions on Robotics and Automation Year : 1994

Approximate solutions for large-scale piecewise deterministic control systems arising in manufacturing flow control models

(1)
1

Abstract

We propose a numerical technique for approximately solving large-scale piecewise deterministic control systems that are typically related to manufacturing flow control problems in unreliable production systems. The method consists of reformulating the stochastic control problem under study into a Markov decision process. Then we exploit the associated dynamic programming conditions and we propose an “approximate” policy iteration algorithm. This will be based on an approximation of the Bellman functions by a combination of a set of base functions, using a specific decomposition technique. The numerical method is applicable whenever a turnpike property holds for some associated infinite horizon deterministic control problem. To illustrate the approach, we solve an example and compare this new approximation method with a more classical approximation-by-decomposition technique
Not file

Dates and versions

hal-00471369 , version 1 (08-04-2010)

Identifiers

Cite

Christian van Delft. Approximate solutions for large-scale piecewise deterministic control systems arising in manufacturing flow control models. IEEE Transactions on Robotics and Automation, 1994, Vol.10,n°2, pp.142-152. ⟨10.1109/70.282539⟩. ⟨hal-00471369⟩

Collections

HEC CNRS
49 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More