January  2012, 32(1): 223-263. doi: 10.3934/dcds.2012.32.223

Hamilton Jacobi Bellman equations in infinite dimensions with quadratic and superquadratic Hamiltonian

1. 

Dipartimento di Matematica e Applicazioni, Università di Milano Bicocca, via Cozzi 53, 20125 Milano, Italy

Received  July 2010 Revised  April 2011 Published  September 2011

We consider Hamilton Jacobi Bellman equations in an infinite dimensional Hilbert space, with quadratic (respectively superquadratic) Hamiltonian and with continuous (respectively lipschitz continuous) final condition. This allows to study stochastic optimal control problems for suitable controlled state equations with unbounded control processes. The results are applied to controlled heat equations.
Citation: Federica Masiero. Hamilton Jacobi Bellman equations in infinite dimensions with quadratic and superquadratic Hamiltonian. Discrete & Continuous Dynamical Systems - A, 2012, 32 (1) : 223-263. doi: 10.3934/dcds.2012.32.223
References:
[1]

J. P. Aubin and H. Frankowska, "Set Valued Analysis,", Birkhäuser, (1990).   Google Scholar

[2]

X. Bao, F. Delbaen and Y. Hu, Backward SDEs with superquadratic growth,, preprint, ().  doi: 10.1007/s00440-010-0271-1.  Google Scholar

[3]

P. Briand and F. Confortola, BSDEs with stochastic Lipschitz condition and quadratic PDEs in Hilbert spaces,, Stochastic Process. Appl., 118 (2008), 818.  doi: 10.1016/j.spa.2007.06.006.  Google Scholar

[4]

P. Briand and Y. Hu, Stability of BSDEs with random terminal time and homogenization of semilinear elliptic PDEs,, J. Funct. Anal., 155 (1998), 455.  doi: 10.1006/jfan.1997.3229.  Google Scholar

[5]

S. Cerrai, A Hille-Yosida theorem for weakly continuous semigroups,, Semigroup Forum, 49 (1994), 349.  doi: 10.1007/BF02573496.  Google Scholar

[6]

S. Cerrai and F. Gozzi, Strong solutions of Cauchy problems associated to weakly continuous semigroups,, Differential Integral Equations, 8 (1995), 465.   Google Scholar

[7]

G. Da Prato and J. Zabczyk, "Stochastic Equations in Infinite Dimensions,", Encyclopedia of Mathematics and its Applications 44, (1992).   Google Scholar

[8]

G. Da Prato and J. Zabczyk, "Second Order Partial Eifferential Equations in Hilbert Spaces,", London Mathematical Society Note Series, (2002).   Google Scholar

[9]

W. H. Fleming and H. M. Soner, "Controlled Markov Processes and Viscosity Solutions,", Applications of Mathematics 25. Springer-Verlag, (1993).   Google Scholar

[10]

M. Fuhrman, Smoothing properties of nonlinear stochastic equations in Hilbert spaces,, NoDEA Nonlinear Differential Equations Appl., 3 (1996), 445.   Google Scholar

[11]

M. Fuhrman, Y. Hu and G. Tessitore, On a class of stochastic optimal control problems related to BSDEs with quadratic growth,, SIAM J. Control Optim., 45 (2006), 1279.  doi: 10.1137/050633548.  Google Scholar

[12]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control,, Ann. Probab., 30 (2002), 1397.  doi: 10.1214/aop/1029867132.  Google Scholar

[13]

F. Gozzi, Regularity of solutions of a second order Hamilton-Jacobi equation and application to a control problem,, Comm. Partial Differential Equations, 20 (1995), 775.   Google Scholar

[14]

F. Gozzi, Global regular solutions of second order Hamilton-Jacobi equations in Hilbert spaces with locally Lipschitz nonlinearities,, J. Math. Anal. Appl., 198 (1996), 399.  doi: 10.1006/jmaa.1996.0090.  Google Scholar

[15]

D. Henry, "Geometric Theory of Semilinear Parabolic Equations,", Lecture Notes in Mathematics, (1981).   Google Scholar

[16]

Y. Hu, P. Imkeller and M. Müller, Utility maximization in incomplete markets,, Ann. Appl. Probab., 15 (2005), 1691.  doi: 10.1214/105051605000000188.  Google Scholar

[17]

M. Kobylanski, Backward stochastic differential equations and partial differential equations with quadratic growth,, Ann. Probab., 28 (2000), 558.  doi: 10.1214/aop/1019160253.  Google Scholar

[18]

J. M. Lasry and P. L. Lions, A remark on regularization in Hilbert spaces,, Israel. J. Math., 55 (1986), 257.   Google Scholar

[19]

F. Masiero, Semilinear Kolmogorov equations and applications to stochastic optimal control,, Appl. Math. Optim., 51 (2005), 201.  doi: 10.1007/s00245-004-0810-6.  Google Scholar

[20]

F. Masiero, Regularizing properties for transition semigroups and semilinear parabolic equations in Banach spaces,, Electron. J. Probab., 12 (2007), 387.   Google Scholar

[21]

E. Pardoux, BSDE's, weak convergence and homogeneization of semilinear PDE's,, in, (1999), 503.   Google Scholar

[22]

E. Pardoux and S. Peng, Adapted solution of a backward stochastic differential equation,, Systems Control Lett., 14 (1990), 55.  doi: 10.1016/0167-6911(90)90082-6.  Google Scholar

[23]

E. Pardoux and S. Peng, Backward stochastic differential equations and quasilinear parabolic partial differential equations,, in, (1992), 200.   Google Scholar

[24]

S. Peszat and J. Zabczyk, Strong Feller property and irreducibility for diffusions on Hilbert sapces,, Ann. Probab., 23 (1995), 157.  doi: 10.1214/aop/1176988381.  Google Scholar

[25]

A. Richou, Numerical simulation of BSDEs with drivers of quadratic growth,, preprint, ().   Google Scholar

show all references

References:
[1]

J. P. Aubin and H. Frankowska, "Set Valued Analysis,", Birkhäuser, (1990).   Google Scholar

[2]

X. Bao, F. Delbaen and Y. Hu, Backward SDEs with superquadratic growth,, preprint, ().  doi: 10.1007/s00440-010-0271-1.  Google Scholar

[3]

P. Briand and F. Confortola, BSDEs with stochastic Lipschitz condition and quadratic PDEs in Hilbert spaces,, Stochastic Process. Appl., 118 (2008), 818.  doi: 10.1016/j.spa.2007.06.006.  Google Scholar

[4]

P. Briand and Y. Hu, Stability of BSDEs with random terminal time and homogenization of semilinear elliptic PDEs,, J. Funct. Anal., 155 (1998), 455.  doi: 10.1006/jfan.1997.3229.  Google Scholar

[5]

S. Cerrai, A Hille-Yosida theorem for weakly continuous semigroups,, Semigroup Forum, 49 (1994), 349.  doi: 10.1007/BF02573496.  Google Scholar

[6]

S. Cerrai and F. Gozzi, Strong solutions of Cauchy problems associated to weakly continuous semigroups,, Differential Integral Equations, 8 (1995), 465.   Google Scholar

[7]

G. Da Prato and J. Zabczyk, "Stochastic Equations in Infinite Dimensions,", Encyclopedia of Mathematics and its Applications 44, (1992).   Google Scholar

[8]

G. Da Prato and J. Zabczyk, "Second Order Partial Eifferential Equations in Hilbert Spaces,", London Mathematical Society Note Series, (2002).   Google Scholar

[9]

W. H. Fleming and H. M. Soner, "Controlled Markov Processes and Viscosity Solutions,", Applications of Mathematics 25. Springer-Verlag, (1993).   Google Scholar

[10]

M. Fuhrman, Smoothing properties of nonlinear stochastic equations in Hilbert spaces,, NoDEA Nonlinear Differential Equations Appl., 3 (1996), 445.   Google Scholar

[11]

M. Fuhrman, Y. Hu and G. Tessitore, On a class of stochastic optimal control problems related to BSDEs with quadratic growth,, SIAM J. Control Optim., 45 (2006), 1279.  doi: 10.1137/050633548.  Google Scholar

[12]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control,, Ann. Probab., 30 (2002), 1397.  doi: 10.1214/aop/1029867132.  Google Scholar

[13]

F. Gozzi, Regularity of solutions of a second order Hamilton-Jacobi equation and application to a control problem,, Comm. Partial Differential Equations, 20 (1995), 775.   Google Scholar

[14]

F. Gozzi, Global regular solutions of second order Hamilton-Jacobi equations in Hilbert spaces with locally Lipschitz nonlinearities,, J. Math. Anal. Appl., 198 (1996), 399.  doi: 10.1006/jmaa.1996.0090.  Google Scholar

[15]

D. Henry, "Geometric Theory of Semilinear Parabolic Equations,", Lecture Notes in Mathematics, (1981).   Google Scholar

[16]

Y. Hu, P. Imkeller and M. Müller, Utility maximization in incomplete markets,, Ann. Appl. Probab., 15 (2005), 1691.  doi: 10.1214/105051605000000188.  Google Scholar

[17]

M. Kobylanski, Backward stochastic differential equations and partial differential equations with quadratic growth,, Ann. Probab., 28 (2000), 558.  doi: 10.1214/aop/1019160253.  Google Scholar

[18]

J. M. Lasry and P. L. Lions, A remark on regularization in Hilbert spaces,, Israel. J. Math., 55 (1986), 257.   Google Scholar

[19]

F. Masiero, Semilinear Kolmogorov equations and applications to stochastic optimal control,, Appl. Math. Optim., 51 (2005), 201.  doi: 10.1007/s00245-004-0810-6.  Google Scholar

[20]

F. Masiero, Regularizing properties for transition semigroups and semilinear parabolic equations in Banach spaces,, Electron. J. Probab., 12 (2007), 387.   Google Scholar

[21]

E. Pardoux, BSDE's, weak convergence and homogeneization of semilinear PDE's,, in, (1999), 503.   Google Scholar

[22]

E. Pardoux and S. Peng, Adapted solution of a backward stochastic differential equation,, Systems Control Lett., 14 (1990), 55.  doi: 10.1016/0167-6911(90)90082-6.  Google Scholar

[23]

E. Pardoux and S. Peng, Backward stochastic differential equations and quasilinear parabolic partial differential equations,, in, (1992), 200.   Google Scholar

[24]

S. Peszat and J. Zabczyk, Strong Feller property and irreducibility for diffusions on Hilbert sapces,, Ann. Probab., 23 (1995), 157.  doi: 10.1214/aop/1176988381.  Google Scholar

[25]

A. Richou, Numerical simulation of BSDEs with drivers of quadratic growth,, preprint, ().   Google Scholar

[1]

Jianhui Huang, Xun Li, Jiongmin Yong. A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon. Mathematical Control & Related Fields, 2015, 5 (1) : 97-139. doi: 10.3934/mcrf.2015.5.97

[2]

Jan A. Van Casteren. On backward stochastic differential equations in infinite dimensions. Discrete & Continuous Dynamical Systems - S, 2013, 6 (3) : 803-824. doi: 10.3934/dcdss.2013.6.803

[3]

Haiyang Wang, Zhen Wu. Time-inconsistent optimal control problem with random coefficients and stochastic equilibrium HJB equation. Mathematical Control & Related Fields, 2015, 5 (3) : 651-678. doi: 10.3934/mcrf.2015.5.651

[4]

Qing Xu. Backward stochastic Schrödinger and infinite-dimensional Hamiltonian equations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (11) : 5379-5412. doi: 10.3934/dcds.2015.35.5379

[5]

Jiongmin Yong. Time-inconsistent optimal control problems and the equilibrium HJB equation. Mathematical Control & Related Fields, 2012, 2 (3) : 271-329. doi: 10.3934/mcrf.2012.2.271

[6]

Ying Hu, Shanjian Tang. Mixed deterministic and random optimal control of linear stochastic systems with quadratic costs. Probability, Uncertainty and Quantitative Risk, 2019, 4 (0) : 1-. doi: 10.1186/s41546-018-0035-x

[7]

Qi Lü, Tianxiao Wang, Xu Zhang. Characterization of optimal feedback for stochastic linear quadratic control problems. Probability, Uncertainty and Quantitative Risk, 2017, 2 (0) : 11-. doi: 10.1186/s41546-017-0022-7

[8]

Silvia Faggian. Boundary control problems with convex cost and dynamic programming in infinite dimension part II: Existence for HJB. Discrete & Continuous Dynamical Systems - A, 2005, 12 (2) : 323-346. doi: 10.3934/dcds.2005.12.323

[9]

Qi Lü, Xu Zhang. Operator-valued backward stochastic Lyapunov equations in infinite dimensions, and its application. Mathematical Control & Related Fields, 2018, 8 (1) : 337-381. doi: 10.3934/mcrf.2018014

[10]

Hanxiao Wang, Jingrui Sun, Jiongmin Yong. Weak closed-loop solvability of stochastic linear-quadratic optimal control problems. Discrete & Continuous Dynamical Systems - A, 2019, 39 (5) : 2785-2805. doi: 10.3934/dcds.2019117

[11]

Jingrui Sun, Hanxiao Wang. Mean-field stochastic linear-quadratic optimal control problems: Weak closed-loop solvability. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020026

[12]

Tijana Levajković, Hermann Mena, Amjad Tuffaha. The stochastic linear quadratic optimal control problem in Hilbert spaces: A polynomial chaos approach. Evolution Equations & Control Theory, 2016, 5 (1) : 105-134. doi: 10.3934/eect.2016.5.105

[13]

Xun Li, Jingrui Sun, Jiongmin Yong. Mean-field stochastic linear quadratic optimal control problems: closed-loop solvability. Probability, Uncertainty and Quantitative Risk, 2016, 1 (0) : 2-. doi: 10.1186/s41546-016-0002-3

[14]

N. U. Ahmed. Existence of optimal output feedback control law for a class of uncertain infinite dimensional stochastic systems: A direct approach. Evolution Equations & Control Theory, 2012, 1 (2) : 235-250. doi: 10.3934/eect.2012.1.235

[15]

Fulvia Confortola, Elisa Mastrogiacomo. Feedback optimal control for stochastic Volterra equations with completely monotone kernels. Mathematical Control & Related Fields, 2015, 5 (2) : 191-235. doi: 10.3934/mcrf.2015.5.191

[16]

Yufeng Shi, Tianxiao Wang, Jiongmin Yong. Optimal control problems of forward-backward stochastic Volterra integral equations. Mathematical Control & Related Fields, 2015, 5 (3) : 613-649. doi: 10.3934/mcrf.2015.5.613

[17]

N. U. Ahmed. Weak solutions of stochastic reaction diffusion equations and their optimal control. Discrete & Continuous Dynamical Systems - S, 2018, 11 (6) : 1011-1029. doi: 10.3934/dcdss.2018059

[18]

Hildebrando M. Rodrigues, J. Solà-Morales, G. K. Nakassima. Stability problems in nonautonomous linear differential equations in infinite dimensions. Communications on Pure & Applied Analysis, 2020, 19 (6) : 3189-3207. doi: 10.3934/cpaa.2020138

[19]

Ishak Alia. Time-inconsistent stochastic optimal control problems: A backward stochastic partial differential equations approach. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020020

[20]

Jiongmin Yong. Stochastic optimal control — A concise introduction. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020027

2019 Impact Factor: 1.338

Metrics

  • PDF downloads (45)
  • HTML views (0)
  • Cited by (4)

Other articles
by authors

[Back to Top]