Convergence of stochastic approximation coupled with perturbation analysis in a class of manufacturing flow control models - Archive ouverte HAL Access content directly
Journal Articles Discrete Event Dynamic Systems Year : 1994

Convergence of stochastic approximation coupled with perturbation analysis in a class of manufacturing flow control models

(1) , , (2)
1
2

Abstract

This paper deals with a class of piecewise determinstic control systems for which the optimal control can be approximated through the use of an optimization-by-simulation approach. The feedback control law is restricted to belong to an a priori fixed class of feedback control laws depending on a (small) finite set of parameters. Under some general conditions developed in this paper, infinitesimal perturbation analysis (IPA) can be used to estimate the gradient of the objective function with respect to these parameters for finite horizon simulation and the consistency of the IPA estimators, as the simulation length goes to infinity, is assured. Also, the parameters can be optimized through a stochastic approximation (SA) algorithm combined with IPA. We prove that in this context, under appropriate conditions, such an approach converges towards the optimum.

Dates and versions

hal-00471357 , version 1 (08-04-2010)

Identifiers

Cite

Christian van Delft, A. Haurie, Pierre L'Ecuyer. Convergence of stochastic approximation coupled with perturbation analysis in a class of manufacturing flow control models. Discrete Event Dynamic Systems, 1994, Vol.4,n°1, pp.87-111. ⟨10.1007/BF01516011⟩. ⟨hal-00471357⟩

Collections

HEC CNRS
46 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More