ContinuousTime Public Good Contribution Under Uncertainty: A Stochastic Control Approach
Abstract
In this paper we study continuoustime stochastic control problems with both monotone and classical controls motivated by the socalled public good contribution problem. That is the problem of n economic agents aiming to maximize their expected utility allocating initial wealth over a given time period between private consumption and irreversible contributions to increase the level of some public good. We investigate the corresponding social planner problem and the case of strategic interaction between the agents, i.e. the public good contribution game. We show existence and uniqueness of the social planner’s optimal policy, we characterize it by necessary and sufficient stochastic Kuhn–Tucker conditions and we provide its expression in terms of the unique optional solution of a stochastic backward equation. Similar stochastic first order conditions prove to be very useful for studying any Nash equilibria of the public good contribution game. In the symmetric case they allow us to prove (qualitative) uniqueness of the Nash equilibrium, which we again construct as the unique optional solution of a stochastic backward equation. We finally also provide a detailed analysis of the socalled free rider effect.
 Authors:
 Bielefeld University, Center for Mathematical Economics (Germany)
 Publication Date:
 OSTI Identifier:
 22617043
 Resource Type:
 Journal Article
 Resource Relation:
 Journal Name: Applied Mathematics and Optimization; Journal Volume: 75; Journal Issue: 3; Other Information: Copyright (c) 2017 Springer Science+Business Media New York; http://www.springerny.com; Country of input: International Atomic Energy Agency (IAEA)
 Country of Publication:
 United States
 Language:
 English
 Subject:
 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; CONTROL; EQUATIONS; EQUILIBRIUM; INTERACTIONS; MATHEMATICAL SOLUTIONS; STOCHASTIC PROCESSES; SYMMETRY; UNCERTAINTY PRINCIPLE
Citation Formats
Ferrari, Giorgio, Email: giorgio.ferrari@unibielefeld.de, Riedel, Frank, Email: frank.riedel@unibielefeld.de, and Steg, JanHenrik, Email: jsteg@unibielefeld.de. ContinuousTime Public Good Contribution Under Uncertainty: A Stochastic Control Approach. United States: N. p., 2017.
Web. doi:10.1007/S0024501693375.
Ferrari, Giorgio, Email: giorgio.ferrari@unibielefeld.de, Riedel, Frank, Email: frank.riedel@unibielefeld.de, & Steg, JanHenrik, Email: jsteg@unibielefeld.de. ContinuousTime Public Good Contribution Under Uncertainty: A Stochastic Control Approach. United States. doi:10.1007/S0024501693375.
Ferrari, Giorgio, Email: giorgio.ferrari@unibielefeld.de, Riedel, Frank, Email: frank.riedel@unibielefeld.de, and Steg, JanHenrik, Email: jsteg@unibielefeld.de. Thu .
"ContinuousTime Public Good Contribution Under Uncertainty: A Stochastic Control Approach". United States.
doi:10.1007/S0024501693375.
@article{osti_22617043,
title = {ContinuousTime Public Good Contribution Under Uncertainty: A Stochastic Control Approach},
author = {Ferrari, Giorgio, Email: giorgio.ferrari@unibielefeld.de and Riedel, Frank, Email: frank.riedel@unibielefeld.de and Steg, JanHenrik, Email: jsteg@unibielefeld.de},
abstractNote = {In this paper we study continuoustime stochastic control problems with both monotone and classical controls motivated by the socalled public good contribution problem. That is the problem of n economic agents aiming to maximize their expected utility allocating initial wealth over a given time period between private consumption and irreversible contributions to increase the level of some public good. We investigate the corresponding social planner problem and the case of strategic interaction between the agents, i.e. the public good contribution game. We show existence and uniqueness of the social planner’s optimal policy, we characterize it by necessary and sufficient stochastic Kuhn–Tucker conditions and we provide its expression in terms of the unique optional solution of a stochastic backward equation. Similar stochastic first order conditions prove to be very useful for studying any Nash equilibria of the public good contribution game. In the symmetric case they allow us to prove (qualitative) uniqueness of the Nash equilibrium, which we again construct as the unique optional solution of a stochastic backward equation. We finally also provide a detailed analysis of the socalled free rider effect.},
doi = {10.1007/S0024501693375},
journal = {Applied Mathematics and Optimization},
number = 3,
volume = 75,
place = {United States},
year = {Thu Jun 15 00:00:00 EDT 2017},
month = {Thu Jun 15 00:00:00 EDT 2017}
}

Most empirical naturalresourcemanagement problems are intertemporal optimization problems under uncertainty. The LinearQuadraticGaussian (LQG) method derives an approximate stochastic solution to such problems. The error in modeling resource dynamics and error in observing resource stocks are incorporated explicitly into the LQG problem solution. The LQG is outlined briefly and applied to the harvestscheduling problem on the Stanislaus National Forest. The importance of knowing management preferences precisely is shown by stochastic simulations. Harvest levels and the cost of a given source of uncertainty are shown to be quite sensitive to the objectivefunction specification, permitting a morerational scheduling of production and allocation ofmore »

Time Discretisation and Rate of Convergence for the Optimal Control of ContinuousTime Stochastic Systems with Delay
We study a semidiscretisation scheme for stochastic optimal control problems whose dynamics are given by controlled stochastic delay (or functional) differential equations with bounded memory. Performance is measured in terms of expected costs. By discretising time in two steps, we construct a sequence of approximating finitedimensional Markovian optimal control problems in discrete time. The corresponding value functions converge to the value function of the original problem, and we derive an upper bound on the discretisation error or, equivalently, a worstcase estimate for the rate of convergence. 
Stochastic Games for ContinuousTime Jump Processes Under FiniteHorizon Payoff Criterion
In this paper we study twoperson nonzerosum games for continuoustime jump processes with the randomized historydependent strategies under the finitehorizon payoff criterion. The state space is countable, and the transition rates and payoff functions are allowed to be unbounded from above and from below. Under the suitable conditions, we introduce a new topology for the set of all randomized Markov multistrategies and establish its compactness and metrizability. Then by constructing the approximating sequences of the transition rates and payoff functions, we show that the optimal value function for each player is a unique solution to the corresponding optimality equation andmore » 
Impulsive Control for ContinuousTime Markov Decision Processes: A Linear Programming Approach
In this paper, we investigate an optimization problem for continuoustime Markov decision processes with both impulsive and continuous controls. We consider the socalled constrained problem where the objective of the controller is to minimize a total expected discounted optimality criterion associated with a cost rate function while keeping other performance criteria of the same form, but associated with different cost rate functions, below some given bounds. Our model allows multiple impulses at the same time moment. The main objective of this work is to study the associated linear program defined on a space of measures including the occupation measures ofmore »