skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Optimal Control for Stochastic Delay Evolution Equations

Abstract

In this paper, we investigate a class of infinite-dimensional optimal control problems, where the state equation is given by a stochastic delay evolution equation with random coefficients, and the corresponding adjoint equation is given by an anticipated backward stochastic evolution equation. We first prove the continuous dependence theorems for stochastic delay evolution equations and anticipated backward stochastic evolution equations, and show the existence and uniqueness of solutions to anticipated backward stochastic evolution equations. Then we establish necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin’s maximum principles. To illustrate the theoretical results, we apply stochastic maximum principles to study two examples, an infinite-dimensional linear-quadratic control problem with delay and an optimal control of a Dirichlet problem for a stochastic partial differential equation with delay. Further applications of the two examples to a Cauchy problem for a controlled linear stochastic partial differential equation and an optimal harvesting problem are also considered.

Authors:
 [1];  [2]
  1. Huzhou University, Department of Mathematical Sciences (China)
  2. York University, Department of Mathematics and Statistics (Canada)
Publication Date:
OSTI Identifier:
22617267
Resource Type:
Journal Article
Resource Relation:
Journal Name: Applied Mathematics and Optimization; Journal Volume: 74; Journal Issue: 1; Other Information: Copyright (c) 2016 Springer Science+Business Media New York; http://www.springer-ny.com; Country of input: International Atomic Energy Agency (IAEA)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICAL METHODS AND COMPUTING; CAUCHY PROBLEM; DIRICHLET PROBLEM; EVOLUTION; MATHEMATICAL SOLUTIONS; OPTIMAL CONTROL; PARTIAL DIFFERENTIAL EQUATIONS; RANDOMNESS; STOCHASTIC PROCESSES

Citation Formats

Meng, Qingxin, E-mail: mqx@hutc.zj.cn, and Shen, Yang, E-mail: skyshen87@gmail.com. Optimal Control for Stochastic Delay Evolution Equations. United States: N. p., 2016. Web. doi:10.1007/S00245-015-9308-2.
Meng, Qingxin, E-mail: mqx@hutc.zj.cn, & Shen, Yang, E-mail: skyshen87@gmail.com. Optimal Control for Stochastic Delay Evolution Equations. United States. doi:10.1007/S00245-015-9308-2.
Meng, Qingxin, E-mail: mqx@hutc.zj.cn, and Shen, Yang, E-mail: skyshen87@gmail.com. 2016. "Optimal Control for Stochastic Delay Evolution Equations". United States. doi:10.1007/S00245-015-9308-2.
@article{osti_22617267,
title = {Optimal Control for Stochastic Delay Evolution Equations},
author = {Meng, Qingxin, E-mail: mqx@hutc.zj.cn and Shen, Yang, E-mail: skyshen87@gmail.com},
abstractNote = {In this paper, we investigate a class of infinite-dimensional optimal control problems, where the state equation is given by a stochastic delay evolution equation with random coefficients, and the corresponding adjoint equation is given by an anticipated backward stochastic evolution equation. We first prove the continuous dependence theorems for stochastic delay evolution equations and anticipated backward stochastic evolution equations, and show the existence and uniqueness of solutions to anticipated backward stochastic evolution equations. Then we establish necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin’s maximum principles. To illustrate the theoretical results, we apply stochastic maximum principles to study two examples, an infinite-dimensional linear-quadratic control problem with delay and an optimal control of a Dirichlet problem for a stochastic partial differential equation with delay. Further applications of the two examples to a Cauchy problem for a controlled linear stochastic partial differential equation and an optimal harvesting problem are also considered.},
doi = {10.1007/S00245-015-9308-2},
journal = {Applied Mathematics and Optimization},
number = 1,
volume = 74,
place = {United States},
year = 2016,
month = 8
}
  • We consider a nonlinear stochastic optimal control problem associated with a stochastic evolution equation. This equation is driven by a continuous martingale in a separable Hilbert space and an unbounded time-dependent linear operator.We derive a stochastic maximum principle for this optimal control problem. Our results are achieved by using the adjoint backward stochastic partial differential equation.
  • We study a semi-discretisation scheme for stochastic optimal control problems whose dynamics are given by controlled stochastic delay (or functional) differential equations with bounded memory. Performance is measured in terms of expected costs. By discretising time in two steps, we construct a sequence of approximating finite-dimensional Markovian optimal control problems in discrete time. The corresponding value functions converge to the value function of the original problem, and we derive an upper bound on the discretisation error or, equivalently, a worst-case estimate for the rate of convergence.
  • Delay is an important and ubiquitous aspect of many biochemical processes. For example, delay plays a central role in the dynamics of genetic regulatory networks as it stems from the sequential assembly of first mRNA and then protein. Genetic regulatory networks are therefore frequently modeled as stochastic birth-death processes with delay. Here, we examine the relationship between delay birth-death processes and their appropriate approximating delay chemical Langevin equations. We prove a quantitative bound on the error between the pathwise realizations of these two processes. Our results hold for both fixed delay and distributed delay. Simulations demonstrate that the delay chemicalmore » Langevin approximation is accurate even at moderate system sizes. It captures dynamical features such as the oscillatory behavior in negative feedback circuits, cross-correlations between nodes in a network, and spatial and temporal information in two commonly studied motifs of metastability in biochemical systems. Overall, these results provide a foundation for using delay stochastic differential equations to approximate the dynamics of birth-death processes with delay.« less
  • We study the Riccati equation arising in a class of quadratic optimal control problems with infinite dimensional stochastic differential state equation and infinite horizon cost functional. We allow the coefficients, both in the state equation and in the cost, to be random.In such a context backward stochastic Riccati equations are backward stochastic differential equations in the whole positive real axis that involve quadratic non-linearities and take values in a non-Hilbertian space. We prove existence of a minimal non-negative solution and, under additional assumptions, its uniqueness. We show that such a solution allows to perform the synthesis of the optimal controlmore » and investigate its attractivity properties. Finally the case where the coefficients are stationary is addressed and an example concerning a controlled wave equation in random media is proposed.« less
  • Semilinear elliptic partial differential equations are solved in a mild sense in an infinite-dimensional Hilbert space. These results are applied to a stochastic optimal control problem with infinite horizon. Applications to controlled stochastic heat and wave equations are given.