Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/springer-journals/weak-convergence-and-fluid-limits-in-optimal-time-to-empty-queueing-pMCQ0gSyAm
References (35)
-
S. Ethier, T. Kurtz (2005)
Markov Processes: Characterization and Convergence -
Sean Meyn (2007)
Control Techniques for Complex Networks: Workload -
S.P. Meyn (2008)
Control Techniques for Complex Networks -
R. Atar, P. Dupuis, A. Shwartz (2003)
An Escape-Time Criterion for Queueing Networks: Asymptotic Risk-Sensitive Control via Differential GamesMath. Oper. Res., 28
-
P. Dupuis, H. Ishii (1991)
On Lipschitz continuity of the solution mapping to the Skorokhod problem -
J.G. Dai, G. Weiss (1996)
Stability and instability of fluid models for certain reentrant linesMath. Oper. Res., 21
-
R. Bass (2011)
Convergence of probability measures -
M. Bardi, I. Capuzzo-Dolcetta (1997)
Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations -
Sean Meyn (2005)
Workload models for stochastic networks: value functions and performance evaluationIEEE Transactions on Automatic Control, 50
-
N. Bäuerle (2001)
Asymptotic optimality of tracking policies in stochastic networksAnnals of Applied Probability, 10
-
W. Fleming, H. Soner, H. Soner, Div Mathematics, Florence Fleming, Serpil Soner (1992)
Controlled Markov processes and viscosity solutions -
J. Dai, Sean Meyn (1995)
Stability and convergence of moments for multiclass queueing networks via fluid limit modelsIEEE Trans. Autom. Control., 40
-
P. Brémaud (1983)
Point processes and queues, martingale dynamicsJournal of the American Statistical Association, 78
-
P. Brémaud (1981)
Point Processes and Queues -
Y. Nazarathy, Gideon Weiss (2009)
Near optimal control of queueing networks over a finite time horizonAnnals of Operations Research, 170
-
Bonaventure Intercontinental (1985)
ON DECISION AND CONTROL -
G. Pang, M.V. Day (2007)
Fluid limits of optimally controlled queueing networksJ. Appl. Math. Stoch. Anal., 2007
-
P. Dupuis, H. Ishii (1991)
On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applicationsStoch. Stoch. Rep., 35
-
S.P. Meyn (1997)
Mathematics of Stochastic Manufacturing Systems -
G. Pang, M. Day (2007)
Research Article Fluid Limits of Optimally Controlled Queueing Networks -
J. Dai, Wuqin Lin (2005)
Maximum Pressure Policies in Stochastic Processing NetworksOper. Res., 53
-
P. Dupuis, K. Ramanan (1999)
Convex duality and the Skorokhod Problem. IIProbability Theory and Related Fields, 115
-
G. Pang, M. Day (2007)
Fluid Limits of Optimally Controlled Queueing NetworksInternational Journal of Stochastic Analysis, 2007
-
H. Kushner (2001)
Heavy Traffic Analysis of Controlled Queueing and Communication Networks -
J. Jacod (1975)
Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingalesZeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete, 31
-
W. Chen, D. Huang, A. Kulkarni, J. Unnikrishnan, Q. Zhu, P. Mehta, S. Meyn, A. Wierman (2009)
Proceedings of the 48th IEEE Conf. on Decision and Control -
P. Dupuis, K. Ramanan (1999)
Convex duality and the Skorokhod problem, I and IIProbab. Theory Relat. Fields, 115
-
L. Rogers, David Williams (2000)
Diffusions, Markov Processes, and Martingales by L. C. G. Rogers -
Wei Chen, Dayu Huang, Ankur Kulkarni, Jayakrishnan Unnikrishnan, Quanyan Zhu, P. Mehta, Sean Meyn, A. Wierman (2009)
Approximate dynamic programming using fluid and diffusion approximations with applications to power managementProceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference
-
Sean Meyn (1997)
The policy iteration algorithm for average reward Markov decision processes with general state spaceIEEE Trans. Autom. Control., 42
-
Sean Meyn (2008)
Stability and Asymptotic Optimality of Generalized MaxWeight PoliciesSIAM J. Control. Optim., 47
-
L.C.G. Rogers, D. Williams (2000)
Diffusions, Markov Processes and Martingales -
J. Dai, Gideon Weiss (1996)
Stability and Instability of Fluid Models for Reentrant LinesMath. Oper. Res., 21
-
J. Dai (1995)
On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit ModelsAnnals of Applied Probability, 5
-
Sean Meyn (2003)
Stability and optimization of queueing networks and their fluid models
- Publisher
- Springer Journals
- Copyright
- Copyright © 2011 by Springer Science+Business Media, LLC
- Subject
- Mathematics; Calculus of Variations and Optimal Control; Optimization; Theoretical, Mathematical and Computational Physics; Numerical and Computational Physics; Mathematical Methods in Physics; Systems Theory, Control
- ISSN
- 0095-4616
- eISSN
- 1432-0606
- DOI
- 10.1007/s00245-011-9144-y
- Publisher site
- See Article on Publisher Site
Abstract
We consider a class of controlled queue length processes, in which the control allocates each server’s effort among the several classes of customers requiring its service. Served customers are routed through the network according to (prescribed) routing probabilities. In the fluid rescaling, $X^{n}(t)=\frac{1}{n} X(nt)$ , we consider the optimal control problem of minimizing the integral of an undiscounted positive running cost until the first time that X n =0. Our main result uses weak convergence ideas to show that the optimal value functions V n of the stochastic control problems for X n ( t ) converge (as n →∞) to the optimal value V of a control problem for the limiting fluid process. This requires certain equicontinuity and boundedness hypotheses on { V n }. We observe that these are essentially the same hypotheses that would be needed for the Barles-Perthame approach in terms of semicontinuous viscosity solutions. Sufficient conditions for these equicontinuity and boundedness properties are briefly discussed.
Journal
Applied Mathematics and Optimization – Springer Journals
Published: Dec 1, 2011