Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Optimal Control of Point Processes with Noisy Observations: The Maximum Principle

Optimal Control of Point Processes with Noisy Observations: The Maximum Principle . This paper studies the optimal control problem for point processes with Gaussian white-noised observations. A general maximum principle is proved for the partially observed optimal control of point processes, without using the associated filtering equation . Adjoint flows—the adjoint processes of the stochastic flows of the optimal system—are introduced, and their relations are established. Adjoint vector fields , which are observation-predictable, are introduced as the solutions of associated backward stochastic integral-partial differential equtionsdriven by the observation process. In a heuristic way, their relations are explained, and the adjoint processes are expressed in terms of the adjoint vector fields, their gradients and Hessians, along the optimal state process. In this way the adjoint processes are naturally connected to the adjoint equationof the associated filtering equation . This shows that the conditional expectation in the maximum condition is computable through filtering the optimal state, as usually expected. Some variants of the partially observed stochastic maximum principle are derived, and the corresponding maximum conditions are quite different from the counterpart for the diffusion case. Finally, as an example, a quadratic optimal control problem with a free Poisson process and a Gaussian white-noised observation is explicitly solved using the partially observed maximum principle. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Applied Mathematics & Optimization Springer Journals

Optimal Control of Point Processes with Noisy Observations: The Maximum Principle

Download PDF
28 pages

Loading next page...
 
/lp/springer-journals/optimal-control-of-point-processes-with-noisy-observations-the-maximum-wdO5HzE8F9

References (24)

Publisher
Springer Journals
Copyright
Copyright © Springer-Verlag New York Inc. 2002
Subject
Mathematics; Calculus of Variations and Optimal Control; Optimization; Systems Theory, Control; Theoretical, Mathematical and Computational Physics; Mathematical Methods in Physics; Numerical and Computational Physics, Simulation
ISSN
0095-4616
eISSN
1432-0606
DOI
10.1007/s00245-001-0031-9
Publisher site
See Article on Publisher Site

Abstract

. This paper studies the optimal control problem for point processes with Gaussian white-noised observations. A general maximum principle is proved for the partially observed optimal control of point processes, without using the associated filtering equation . Adjoint flows—the adjoint processes of the stochastic flows of the optimal system—are introduced, and their relations are established. Adjoint vector fields , which are observation-predictable, are introduced as the solutions of associated backward stochastic integral-partial differential equtionsdriven by the observation process. In a heuristic way, their relations are explained, and the adjoint processes are expressed in terms of the adjoint vector fields, their gradients and Hessians, along the optimal state process. In this way the adjoint processes are naturally connected to the adjoint equationof the associated filtering equation . This shows that the conditional expectation in the maximum condition is computable through filtering the optimal state, as usually expected. Some variants of the partially observed stochastic maximum principle are derived, and the corresponding maximum conditions are quite different from the counterpart for the diffusion case. Finally, as an example, a quadratic optimal control problem with a free Poisson process and a Gaussian white-noised observation is explicitly solved using the partially observed maximum principle.

Journal

Applied Mathematics & Optimization – Springer Journals

Published: Jan 1, 2002

Keywords: Point processes; Partially observed optimal control; Adjoint vector fields; Maximum principle; Backward stochastic integral-partial differential equations; AMS Classification. Primary 93E20, 93E11, Secondary 60G15, 60H25.

There are no references for this article.