Optimal Control of Point Processes with Noisy Observations: The Maximum Principle
- Department of Mathematics, Fudan University, Shanghai 200433 (China)
- Department of Applied Mathematics, Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong (China)
This paper studies the optimal control problem for point processes with Gaussian white-noised observations. A general maximum principle is proved for the partially observed optimal control of point processes, without using the associated filtering equation . Adjoint flows-the adjoint processes of the stochastic flows of the optimal system-are introduced, and their relations are established. Adjoint vector fields , which are observation-predictable, are introduced as the solutions of associated backward stochastic integral-partial differential equations driven by the observation process. In a heuristic way, their relations are explained, and the adjoint processes are expressed in terms of the adjoint vector fields, their gradients and Hessians, along the optimal state process. In this way the adjoint processes are naturally connected to the adjoint equation of the associated filtering equation . This shows that the conditional expectation in the maximum condition is computable through filtering the optimal state, as usually expected. Some variants of the partially observed stochastic maximum principle are derived, and the corresponding maximum conditions are quite different from the counterpart for the diffusion case. Finally, as an example, a quadratic optimal control problem with a free Poisson process and a Gaussian white-noised observation is explicitly solved using the partially observed maximum principle.
- OSTI ID:
- 21067496
- Journal Information:
- Applied Mathematics and Optimization, Vol. 45, Issue 2; Other Information: DOI: 10.1007/s00245-001-0031-9; Copyright (c) Inc. 2001 Springer-Verlag New York; Country of input: International Atomic Energy Agency (IAEA); ISSN 0095-4616
- Country of Publication:
- United States
- Language:
- English
Similar Records
Robust Dynamics and Control of a Partially Observed Markov Chain
A General Stochastic Maximum Principle for SDEs of Mean-field Type