American Institute of Mathematical Sciences

Advanced
June  2015, 5(2): 191-235. doi: 10.3934/mcrf.2015.5.191

Feedback optimal control for stochastic Volterra equations with completely monotone kernels

Fulvia Confortola 1, and  Elisa Mastrogiacomo 2,

1. 

Dipartimento di Matematica, Politecnico di Milano, Piazza Leonardo da Vinci, 32 - 20133 Milano
2. 

Dipartimento di statistica e metodi quantitativi, Universitá degli studi di Milano Bicocca, Piazza dell'Ateneo Nuovo, 1 - 20126, Milano

Received  September 2013 Revised  August 2014 Published  April 2015

In this paper we are concerned with a class of stochastic Volterra integro-differential problems with completely monotone kernels, where we assume that the noise enters the system when we introduce a control. We start by reformulating the state equation into a semilinear evolution equation which can be treated by semigroup methods. The application to optimal control provides other interesting results and requires a precise description of the properties of the generated semigroup.
    The first main result of the paper is the proof of existence and uniqueness of a mild solution for the corresponding Hamilton-Jacobi-Bellman (HJB) equation. The main technical point consists in the differentiability of the BSDE associated with the reformulated equation with respect to its initial datum $x$.
Keywords: optimal control, backward stochastic differential equations, HJB equation, Stochastic Volterra integral equation, feedback law..
Mathematics Subject Classification: 45D05, 93E20, 60H3.
Citation: Fulvia Confortola, Elisa Mastrogiacomo. Feedback optimal control for stochastic Volterra equations with completely monotone kernels. Mathematical Control & Related Fields, 2015, 5 (2) : 191-235. doi: 10.3934/mcrf.2015.5.191
References:
[1]

O. P. Agrawal, Solution for a fractional diffusion-wave equation defined in a bounded domain,, Nonlinear Dynamics, 29 (2002), 145.  doi: 10.1023/A:1016539022492.  Google Scholar

[2]

S. A. Belbas, A new method for optimal control of Volterra integral equations,, Appl. Math. Comput., 189 (2007), 1902.  doi: 10.1016/j.amc.2006.12.077.  Google Scholar

[3]

S. Bonaccorsi, Some Applications in Malliavin Calculus,, Ph.D thesis, (1998).   Google Scholar

[4]

S. Bonaccorsi and G. Desch, Volterra equations in Banach spaces with completely monotone kernels,, NoDEA Nonlinear Differential Equations Appl., 20 (2013), 557.  doi: 10.1007/s00030-012-0167-0.  Google Scholar

[5]

S. Bonaccorsi and E. Mastrogiacomo, An analytic approach to stochastic Volterra equations with completely monotone kernels,, J. Evol. Equ., 9 (2009), 315.  doi: 10.1007/s00028-009-0010-1.  Google Scholar

[6]

S. Bonaccorsi, F. Confortola and E. Mastrogiacomo, Optimal control for stochastic Volterra equations with completely monotone kernels,, SIAM J. Control Optim., 50 (2012), 748.  doi: 10.1137/100782875.  Google Scholar

[7]

P. Briand and F. Confortola, SDEs with stochastic Lipschitz condition and quadratic PDEs in Hilbert spaces,, Stochastic Process. Appl., 118 (2008), 818.  doi: 10.1016/j.spa.2007.06.006.  Google Scholar

[8]

F. Confortola and E. Mastrogiacomo, Optimal control for stochastic heat equation with memory,, Evolution Equations and Control Theory, 3 (2014), 35.  doi: 10.3934/eect.2014.3.35.  Google Scholar

[9]

G. Da Prato and J. Zabczyk, Evolution Equations with White-Noise Boundary Conditions,, Cambridge Univ. Press, (1993).  doi: 10.1080/17442509308833817.  Google Scholar

[10]

G. Da Prato and J. Zabczyk, Stochastic Equations in Infinite Dimensions,, Cambridge Univ. Press, (1992).  doi: 10.1017/CBO9780511666223.  Google Scholar

[11]

A. Debussche, M. Fuhrman and G. Tessitore, Optimal control of a stochastic heat equation with boundary-noise and boundary-control,, ESAIM Control Optim. Calc. Var., 13 (2007), 178.  doi: 10.1051/cocv:2007001.  Google Scholar

[12]

W. Desch and R. K. Miller, Exponential stabilization of Volterra integral equations with singular kernels,, J. Integral Equations Appl., 1 (1988), 397.  doi: 10.1216/JIE-1988-1-3-397.  Google Scholar

[13]

K. J. Engel and R. Nagel, One-parameter Semigroups for Linear Evolution Equations,, Graduate Texts in Math., (2000).   Google Scholar

[14]

W. H. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions,, Springer-Verlag, (1993).   Google Scholar

[15]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control,, Ann. Probab., 30 (2002), 1397.  doi: 10.1214/aop/1029867132.  Google Scholar

[16]

G. Gripenberg, S. O. Londen and O. Staffans, Volterra Integral and Functional Equations,, Cambridge University Press, (1990).  doi: 10.1017/CBO9780511662805.  Google Scholar

[17]

A. Grorud and E. Pardoux, Intégrales Hilbertiennes anticipantes par rapport à un processus de Wienner cylindrique et calcul stochastique associé,, Appl. Math. Optim., 25 (1992), 31.  doi: 10.1007/BF01184155.  Google Scholar

[18]

K. W. Homan, An Analytic Semigroup Approach to Convolution Volterra Equations,, Ph.D. Thesis, (2003).   Google Scholar

[19]

G. E. Ladas and V. Lakshmikantham, Differential Equations in Abstract Spaces,, Mathematics in Science and Engineering, (1972).   Google Scholar

[20]

A. Lunardi, Analytic Semigroups and Optimal Regularity in Parabolic Problems,, 2013 reprint of the 1995 original, (1995).   Google Scholar

[21]

F. Masiero, A stochastic optimal control problem for the heat equation on the halfline with dirichlet boundary-noise and boundary-control,, Appl. Math. Optim., 62 (2010), 253.  doi: 10.1007/s00245-010-9103-z.  Google Scholar

[22]

R. K. Miller, Linear Volterra integrodifferential equations as semigroups,, Funkcial. Ekvac., 17 (1974), 39.   Google Scholar

[23]

D. Nualart, Malliavin Calculus and Related Topics,, Probability and its Applications (New York), (2006).   Google Scholar

[24]

B. Øksendal and T. Zhang, The stochastic Volterra equation,, in Barcelona Seminar on Stochastic Analysis (St. Feliu de Guíxols, (1991), 168.   Google Scholar

[25]

B. Øksendal and T. Zhang, The general linear stochastic Volterra equations with anticipating coefficients,, in Stochastic Analysis and Applications (Powys, (1995), 343.   Google Scholar

[26]

E. Pardoux, Nonlinear filtering, prediction and smoothing equations,, Stochastics, 6 (): 193.  doi: 10.1080/17442508208833204.  Google Scholar

[27]

J. Prüss, Evolutionary Integral Equations and Applications,, Monographs in Mathematics, (1993).  doi: 10.1007/978-3-0348-8570-6.  Google Scholar

[28]

W. R. Schneider and W. Wyss, Fractional diffusion and wave equations,, Journal of Mathematical Physics, 30 (1989), 134.  doi: 10.1063/1.528578.  Google Scholar

show all references

References:
[1]

O. P. Agrawal, Solution for a fractional diffusion-wave equation defined in a bounded domain,, Nonlinear Dynamics, 29 (2002), 145.  doi: 10.1023/A:1016539022492.  Google Scholar

[2]

S. A. Belbas, A new method for optimal control of Volterra integral equations,, Appl. Math. Comput., 189 (2007), 1902.  doi: 10.1016/j.amc.2006.12.077.  Google Scholar

[3]

S. Bonaccorsi, Some Applications in Malliavin Calculus,, Ph.D thesis, (1998).   Google Scholar

[4]

S. Bonaccorsi and G. Desch, Volterra equations in Banach spaces with completely monotone kernels,, NoDEA Nonlinear Differential Equations Appl., 20 (2013), 557.  doi: 10.1007/s00030-012-0167-0.  Google Scholar

[5]

S. Bonaccorsi and E. Mastrogiacomo, An analytic approach to stochastic Volterra equations with completely monotone kernels,, J. Evol. Equ., 9 (2009), 315.  doi: 10.1007/s00028-009-0010-1.  Google Scholar

[6]

S. Bonaccorsi, F. Confortola and E. Mastrogiacomo, Optimal control for stochastic Volterra equations with completely monotone kernels,, SIAM J. Control Optim., 50 (2012), 748.  doi: 10.1137/100782875.  Google Scholar

[7]

P. Briand and F. Confortola, SDEs with stochastic Lipschitz condition and quadratic PDEs in Hilbert spaces,, Stochastic Process. Appl., 118 (2008), 818.  doi: 10.1016/j.spa.2007.06.006.  Google Scholar

[8]

F. Confortola and E. Mastrogiacomo, Optimal control for stochastic heat equation with memory,, Evolution Equations and Control Theory, 3 (2014), 35.  doi: 10.3934/eect.2014.3.35.  Google Scholar

[9]

G. Da Prato and J. Zabczyk, Evolution Equations with White-Noise Boundary Conditions,, Cambridge Univ. Press, (1993).  doi: 10.1080/17442509308833817.  Google Scholar

[10]

G. Da Prato and J. Zabczyk, Stochastic Equations in Infinite Dimensions,, Cambridge Univ. Press, (1992).  doi: 10.1017/CBO9780511666223.  Google Scholar

[11]

A. Debussche, M. Fuhrman and G. Tessitore, Optimal control of a stochastic heat equation with boundary-noise and boundary-control,, ESAIM Control Optim. Calc. Var., 13 (2007), 178.  doi: 10.1051/cocv:2007001.  Google Scholar

[12]

W. Desch and R. K. Miller, Exponential stabilization of Volterra integral equations with singular kernels,, J. Integral Equations Appl., 1 (1988), 397.  doi: 10.1216/JIE-1988-1-3-397.  Google Scholar

[13]

K. J. Engel and R. Nagel, One-parameter Semigroups for Linear Evolution Equations,, Graduate Texts in Math., (2000).   Google Scholar

[14]

W. H. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions,, Springer-Verlag, (1993).   Google Scholar

[15]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control,, Ann. Probab., 30 (2002), 1397.  doi: 10.1214/aop/1029867132.  Google Scholar

[16]

G. Gripenberg, S. O. Londen and O. Staffans, Volterra Integral and Functional Equations,, Cambridge University Press, (1990).  doi: 10.1017/CBO9780511662805.  Google Scholar

[17]

A. Grorud and E. Pardoux, Intégrales Hilbertiennes anticipantes par rapport à un processus de Wienner cylindrique et calcul stochastique associé,, Appl. Math. Optim., 25 (1992), 31.  doi: 10.1007/BF01184155.  Google Scholar

[18]

K. W. Homan, An Analytic Semigroup Approach to Convolution Volterra Equations,, Ph.D. Thesis, (2003).   Google Scholar

[19]

G. E. Ladas and V. Lakshmikantham, Differential Equations in Abstract Spaces,, Mathematics in Science and Engineering, (1972).   Google Scholar

[20]

A. Lunardi, Analytic Semigroups and Optimal Regularity in Parabolic Problems,, 2013 reprint of the 1995 original, (1995).   Google Scholar

[21]

F. Masiero, A stochastic optimal control problem for the heat equation on the halfline with dirichlet boundary-noise and boundary-control,, Appl. Math. Optim., 62 (2010), 253.  doi: 10.1007/s00245-010-9103-z.  Google Scholar

[22]

R. K. Miller, Linear Volterra integrodifferential equations as semigroups,, Funkcial. Ekvac., 17 (1974), 39.   Google Scholar

[23]

D. Nualart, Malliavin Calculus and Related Topics,, Probability and its Applications (New York), (2006).   Google Scholar

[24]

B. Øksendal and T. Zhang, The stochastic Volterra equation,, in Barcelona Seminar on Stochastic Analysis (St. Feliu de Guíxols, (1991), 168.   Google Scholar

[25]

B. Øksendal and T. Zhang, The general linear stochastic Volterra equations with anticipating coefficients,, in Stochastic Analysis and Applications (Powys, (1995), 343.   Google Scholar

[26]

E. Pardoux, Nonlinear filtering, prediction and smoothing equations,, Stochastics, 6 (): 193.  doi: 10.1080/17442508208833204.  Google Scholar

[27]

J. Prüss, Evolutionary Integral Equations and Applications,, Monographs in Mathematics, (1993).  doi: 10.1007/978-3-0348-8570-6.  Google Scholar

[28]

W. R. Schneider and W. Wyss, Fractional diffusion and wave equations,, Journal of Mathematical Physics, 30 (1989), 134.  doi: 10.1063/1.528578.  Google Scholar

[1]

Reza Chaharpashlou, Abdon Atangana, Reza Saadati. On the fuzzy stability results for fractional stochastic Volterra integral equation. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020432
[2]

Yueyang Zheng, Jingtao Shi. A stackelberg game of backward stochastic differential equations with partial information. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020047
[3]

Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020317
[4]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264
[5]

Zhenzhen Wang, Tianshou Zhou. Asymptotic behaviors and stochastic traveling waves in stochastic Fisher-KPP equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020323
[6]

Xuhui Peng, Rangrang Zhang. Approximations of stochastic 3D tamed Navier-Stokes equations. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5337-5365. doi: 10.3934/cpaa.2020241
[7]

Christian Beck, Lukas Gonon, Martin Hutzenthaler, Arnulf Jentzen. On existence and uniqueness properties for solutions of stochastic fixed point equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020320
[8]

Yangrong Li, Shuang Yang, Qiangheng Zhang. Odd random attractors for stochastic non-autonomous Kuramoto-Sivashinsky equations without dissipation. Electronic Research Archive, 2020, 28 (4) : 1529-1544. doi: 10.3934/era.2020080
[9]

Pengyu Chen. Non-autonomous stochastic evolution equations with nonlinear noise and nonlocal conditions governed by noncompact evolution families. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020383
[10]

Lin Shi, Xuemin Wang, Dingshi Li. Limiting behavior of non-autonomous stochastic reaction-diffusion equations with colored noise on unbounded thin domains. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5367-5386. doi: 10.3934/cpaa.2020242
[11]

Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020046
[12]

Fabio Camilli, Giulia Cavagnari, Raul De Maio, Benedetto Piccoli. Superposition principle and schemes for measure differential equations. Kinetic & Related Models, , () : -. doi: 10.3934/krm.2020050
[13]

Youming Guo, Tingting Li. Optimal control strategies for an online game addiction model with low and high risk exposure. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020347
[14]

Yahia Zare Mehrjerdi. A new methodology for solving bi-criterion fractional stochastic programming. Numerical Algebra, Control & Optimization, 2020  doi: 10.3934/naco.2020054
[15]

Giuseppina Guatteri, Federica Masiero. Stochastic maximum principle for problems with delay with dependence on the past through general measures. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020048
[16]

Bernard Bonnard, Jérémy Rouot. Geometric optimal techniques to control the muscular force response to functional electrical stimulation using a non-isometric force-fatigue model. Journal of Geometric Mechanics, 2020  doi: 10.3934/jgm.2020032
[17]

Peter Poláčik, Pavol Quittner. Entire and ancient solutions of a supercritical semilinear heat equation. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 413-438. doi: 10.3934/dcds.2020136
[18]

Jianhua Huang, Yanbin Tang, Ming Wang. Singular support of the global attractor for a damped BBM equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020345
[19]

Stefano Bianchini, Paolo Bonicatto. Forward untangling and applications to the uniqueness problem for the continuity equation. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020384
[20]

Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077

2019 Impact Factor: 0.857

Tools

Metrics

  • PDF downloads (37)
  • HTML views (0)
  • Cited by (2)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences