skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Error Estimates for a Stochastic Impulse Control Problem

Abstract

We obtain error bounds for monotone approximation schemes of a stochastic impulse control problem. This is an extension of the theory for error estimates for the Hamilton-Jacobi-Bellman equation. We obtain almost the same estimate on the rate of convergence as in the equation without impulsions.

Authors:
; ;  [1]
  1. CMAP, Ecole Polytechnique, INRIA-Futurs (France), E-mail: Hasnaa.Zidani@ensta.fr
Publication Date:
OSTI Identifier:
21067407
Resource Type:
Journal Article
Resource Relation:
Journal Name: Applied Mathematics and Optimization; Journal Volume: 55; Journal Issue: 3; Other Information: DOI: 10.1007/s00245-006-0865-2; Copyright (c) 2007 Springer; www.springer-ny.com; Country of input: International Atomic Energy Agency (IAEA)
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; APPROXIMATIONS; CONTROL THEORY; CONVERGENCE; ERRORS; HAMILTON-JACOBI EQUATIONS; STOCHASTIC PROCESSES

Citation Formats

Bonnans, Frederic, E-mail: Frederic.Bonnas@inria.fr, Maroso, Stefania, E-mail: maroso@cmapx.polytechnique.fr, and Zidani, Housnaa. Error Estimates for a Stochastic Impulse Control Problem. United States: N. p., 2007. Web. doi:10.1007/S00245-006-0865-2.
Bonnans, Frederic, E-mail: Frederic.Bonnas@inria.fr, Maroso, Stefania, E-mail: maroso@cmapx.polytechnique.fr, & Zidani, Housnaa. Error Estimates for a Stochastic Impulse Control Problem. United States. doi:10.1007/S00245-006-0865-2.
Bonnans, Frederic, E-mail: Frederic.Bonnas@inria.fr, Maroso, Stefania, E-mail: maroso@cmapx.polytechnique.fr, and Zidani, Housnaa. Tue . "Error Estimates for a Stochastic Impulse Control Problem". United States. doi:10.1007/S00245-006-0865-2.
@article{osti_21067407,
title = {Error Estimates for a Stochastic Impulse Control Problem},
author = {Bonnans, Frederic, E-mail: Frederic.Bonnas@inria.fr and Maroso, Stefania, E-mail: maroso@cmapx.polytechnique.fr and Zidani, Housnaa},
abstractNote = {We obtain error bounds for monotone approximation schemes of a stochastic impulse control problem. This is an extension of the theory for error estimates for the Hamilton-Jacobi-Bellman equation. We obtain almost the same estimate on the rate of convergence as in the equation without impulsions.},
doi = {10.1007/S00245-006-0865-2},
journal = {Applied Mathematics and Optimization},
number = 3,
volume = 55,
place = {United States},
year = {Tue May 15 00:00:00 EDT 2007},
month = {Tue May 15 00:00:00 EDT 2007}
}
  • This work is concerned with stochastic optimal control for a running maximum cost. A direct approach based on dynamic programming techniques is studied leading to the characterization of the value function as the unique viscosity solution of a second order Hamilton–Jacobi–Bellman (HJB) equation with an oblique derivative boundary condition. A general numerical scheme is proposed and a convergence result is provided. Error estimates are obtained for the semi-Lagrangian scheme. These results can apply to the case of lookback options in finance. Moreover, optimal control problems with maximum cost arise in the characterization of the reachable sets for a system ofmore » controlled stochastic differential equations. Some numerical simulations on examples of reachable analysis are included to illustrate our approach.« less
  • In this paper we are dealing with a partial differential equation of parabolic type, which degenerates on one side of the domain. This equation may be viewed either as a model of particle diffusion in plasma physics, or as a simplified model of a viscous boundary layer in two dimensions. Known results for the existence and uniqueness of the weak solution are first recalled. A finite difference implicit scheme is then defined, and error bounds are derived, taking into account the low degree of smoothness of the exact solution. An iterative algorithm for the computation of the numerical solution atmore » each time step is shown to be convergent. 20 refs.« less
  • We study impulse control problems of jump diffusions with delayed reaction. This means that there is a delay {delta}>0 between the time when a decision for intervention is taken and the time when the intervention is actually carried out. We show that under certain conditions this problem can be transformed into a sequence of iterated no-delay optimal stopping problems and there is an explicit relation between the solutions of these two problems. The results are illustrated by an example where the problem is to find the optimal times to increase the production capacity of a firm, assuming that there aremore » transaction costs with each new order and the increase takes place {delta} time units after the (irreversible) order has been placed.« less
  • We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot apply quasi-variational inequalities techniques. We rather derive the main results using techniques involving reflected BSDEs and the Snell envelope.
  • We consider a boundary optimal control problem for the acoustic wave equation with a final value cost criterion. A time-domain decomposition procedure for the corresponding optimality system is introduced, which leads to a sequence of uncoupled optimality systems of local-in-time optimal control problems. The process is inherently parallel and is suitable for real-time control applications. Convergence of the local solutions and controls to the global ones was established in an earlier publication. In this paper, a posteriori error estimates of the difference between the local solutions and the global one are obtained in terms of the mismatch of the nmore » th iterates, or of successive iterates, across the time-domain break points.« less