American Institute of Mathematical Sciences

Advanced
doi: 10.3934/mcrf.2020048

Stochastic maximum principle for problems with delay with dependence on the past through general measures

Giuseppina Guatteri 1, and  Federica Masiero 2,,

1. 

Dipartimento di Matematica, Politecnico di Milano, via Bonardi 9, 20133 Milano, Italia
2. 

Dipartimento di Matematica e Applicazioni, Università di Milano-Bicocca, via Cozzi 55, 20125 Milano, Italia

* Corresponding author: Federica Masiero

Received  February 2020 Revised  September 2020 Published  November 2020

We prove a stochastic maximum principle for a control problem where the state equation is delayed both in the state and in the control, and both the running and the final cost functionals may depend on the past trajectories. The adjoint equation turns out to be a new form of linear anticipated backward stochastic differential equations (ABSDEs in the following), and we prove a direct formula to solve these equations.

Keywords: Stochastic maximum principle, delay, anticipated backward stochastic differential equations.
Mathematics Subject Classification: 60H10, 93E20.
Citation: Giuseppina Guatteri, Federica Masiero. Stochastic maximum principle for problems with delay with dependence on the past through general measures. Mathematical Control & Related Fields, doi: 10.3934/mcrf.2020048
References:
[1]

E. Bandini, A. Cosso, M. Fuhrman and H. Pham, Backward SDEs for optimal control of partially observed path-dependent stochastic systems: A control randomization approach, Ann. Appl. Probab., 28 (2018), 1634-1678.  doi: 10.1214/17-AAP1340.  Google Scholar

[2]

B. Bruder and H. Pham, Impulse control problem on finite horizon with execution delay, Stochastic Process. Appl., 119 (2009), 1436-1469.  doi: 10.1016/j.spa.2008.07.007.  Google Scholar

[3]

R. Buckdahn, H.-J. Engelbert and A. Răşcanu, On weak solutions of backward stochastic differential equations, Teor. Veroyatn. Primen., 49 (2004), 70-108.  doi: 10.4213/tvp237.  Google Scholar

[4]

L. Chen, Z. Wu and Z. Yu, Maximum principle for the stochastic optimal control problem with delay and application, Automatica J. IFAC, 46 (2010), 1074-1080.  doi: 10.1016/j.automatica.2010.03.005.  Google Scholar

[5]

L. Chen and Z. Wu, Delayed stochastic linear-quadratic control problem and related applications, Journal of Applied Mathematics, 2012 (2012), 835319, 22 pp. doi: 10.1155/2012/835319.  Google Scholar

[6]

Y. Eidelman, V. Milman and A. Tsolomitis, Functional Analysis, An Introduction, Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2004. doi: 10.1090/gsm/066.  Google Scholar

[7]

N. El Karoui, S. Peng and M. C. Quenez, Backward stochastic differential equations in finance, Math. Finance, 7 (1997), 1-71.  doi: 10.1111/1467-9965.00022.  Google Scholar

[8]

G. Fabbri and S. Federico, On the infinite-dimensional representation of stochastic controlled systems with delayed control in the diffusion term, Mathematical Economics Letters, 2 (2014), 33-44.  doi: 10.1515/mel-2014-0011.  Google Scholar

[9]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control, Ann. Probab., 30 (2002), 1397-1465.  doi: 10.1214/aop/1029867132.  Google Scholar

[10]

F. Gozzi and C. Marinelli, Stochastic optimal control of delay equations arising in advertising models, Stochastic partial differential equations and applications—VII, Lect. Notes Pure Appl. Math., Chapman & Hall/CRC, Boca Raton, FL, 245 (2006), 133–148.  Google Scholar

[11]

F. Gozzi, C. Marinelli and S. Savin, On controlled linear diffusions with delay in a model of optimal advertising under uncertainty with memory effects, J. Optim. Theory Appl., 142 (2009), 291-321.  doi: 10.1007/s10957-009-9524-5.  Google Scholar

[12]

F. Gozzi and F. Masiero, Stochastic optimal control with delay in the control II:Verification theorem and optimal feedbacks, SIAM J. Control Optim., 55 (2017), 3013-3038.  doi: 10.1137/16M1073637.  Google Scholar

[13]

L. Grosset and B. Viscolani, Advertising for a new product introduction: A stochastic approach, Top, 12 (2004), 149-167.  doi: 10.1007/BF02578929.  Google Scholar

[14]

G. Guatteri, F. Masiero and C. Orrieri, Stochastic maximum principle for SPDEs with delay, Stochastic Process. Appl., 127 (2017), 2396-2427.  doi: 10.1016/j.spa.2016.11.007.  Google Scholar

[15]

R. F. Hartl, Optimal dynamic advertising policies for hereditary processes, J. Optim. Theory Appl., 43 (1984), 51-72.  doi: 10.1007/BF00934746.  Google Scholar

[16]

Y. Hu and S. Peng, Maximum principle for semilinear stochastic evolution control systems, Stochastics Stochastics Rep., 33 (1990), 159-180.  doi: 10.1080/17442509008833671.  Google Scholar

[17]

Y. Hu and S. Peng, Maximum principle for optimal control of stochastic system of functional type, Stochastic Anal. Appl., 14 (1996), 283-301.  doi: 10.1080/07362999608809440.  Google Scholar

[18]

S.-E. A. Mohammed, Stochastic differential systems with memory: Theory, examples and applications. Stochastic analysis and related topics VI, Progr. Probab., Birkhäuser Boston, Boston, MA, 42 (1998), 1–77.  Google Scholar

[19]

B. Øksendal, A. Sulem and T. Zhang, Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations, Adv. in Appl. Probab., 43 (2011), 572-596.  doi: 10.1239/aap/1308662493.  Google Scholar

[20]

C. Orrieri, E. Rocca and L. Scarpa, Optimal control of stochastic phase-field models related to tumor growth, ESAIM Control Optim. Calc. Var., forthcoming. doi: 10.1051/cocv/2020022.  Google Scholar

[21]

E. Pardoux and A. Răşcanu, Stochastic Differential Equations, Backward SDEs, Partial Differential Equations, Stochastic Modelling and Applied Probability, Springer, Cham, 2014. doi: 10.1007/978-3-319-05714-9.  Google Scholar

[22]

S. Peng and Z. Yang, Anticipated backward stochastic differential equations, Ann. Probab., 37 (2009), 877-902.  doi: 10.1214/08-AOP423.  Google Scholar

[23]

Z. Yang and R. J. Elliott, Some properties of generalized anticipated backward stochastic differential equations, Electron. Commun. Probab., 18 (2013), 10. doi: 10.1214/ECP.v18-2415.  Google Scholar

[24]

J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, New York, Springer-Verlag, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar

show all references

References:
[1]

E. Bandini, A. Cosso, M. Fuhrman and H. Pham, Backward SDEs for optimal control of partially observed path-dependent stochastic systems: A control randomization approach, Ann. Appl. Probab., 28 (2018), 1634-1678.  doi: 10.1214/17-AAP1340.  Google Scholar

[2]

B. Bruder and H. Pham, Impulse control problem on finite horizon with execution delay, Stochastic Process. Appl., 119 (2009), 1436-1469.  doi: 10.1016/j.spa.2008.07.007.  Google Scholar

[3]

R. Buckdahn, H.-J. Engelbert and A. Răşcanu, On weak solutions of backward stochastic differential equations, Teor. Veroyatn. Primen., 49 (2004), 70-108.  doi: 10.4213/tvp237.  Google Scholar

[4]

L. Chen, Z. Wu and Z. Yu, Maximum principle for the stochastic optimal control problem with delay and application, Automatica J. IFAC, 46 (2010), 1074-1080.  doi: 10.1016/j.automatica.2010.03.005.  Google Scholar

[5]

L. Chen and Z. Wu, Delayed stochastic linear-quadratic control problem and related applications, Journal of Applied Mathematics, 2012 (2012), 835319, 22 pp. doi: 10.1155/2012/835319.  Google Scholar

[6]

Y. Eidelman, V. Milman and A. Tsolomitis, Functional Analysis, An Introduction, Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2004. doi: 10.1090/gsm/066.  Google Scholar

[7]

N. El Karoui, S. Peng and M. C. Quenez, Backward stochastic differential equations in finance, Math. Finance, 7 (1997), 1-71.  doi: 10.1111/1467-9965.00022.  Google Scholar

[8]

G. Fabbri and S. Federico, On the infinite-dimensional representation of stochastic controlled systems with delayed control in the diffusion term, Mathematical Economics Letters, 2 (2014), 33-44.  doi: 10.1515/mel-2014-0011.  Google Scholar

[9]

M. Fuhrman and G. Tessitore, Nonlinear Kolmogorov equations in infinite dimensional spaces: The backward stochastic differential equations approach and applications to optimal control, Ann. Probab., 30 (2002), 1397-1465.  doi: 10.1214/aop/1029867132.  Google Scholar

[10]

F. Gozzi and C. Marinelli, Stochastic optimal control of delay equations arising in advertising models, Stochastic partial differential equations and applications—VII, Lect. Notes Pure Appl. Math., Chapman & Hall/CRC, Boca Raton, FL, 245 (2006), 133–148.  Google Scholar

[11]

F. Gozzi, C. Marinelli and S. Savin, On controlled linear diffusions with delay in a model of optimal advertising under uncertainty with memory effects, J. Optim. Theory Appl., 142 (2009), 291-321.  doi: 10.1007/s10957-009-9524-5.  Google Scholar

[12]

F. Gozzi and F. Masiero, Stochastic optimal control with delay in the control II:Verification theorem and optimal feedbacks, SIAM J. Control Optim., 55 (2017), 3013-3038.  doi: 10.1137/16M1073637.  Google Scholar

[13]

L. Grosset and B. Viscolani, Advertising for a new product introduction: A stochastic approach, Top, 12 (2004), 149-167.  doi: 10.1007/BF02578929.  Google Scholar

[14]

G. Guatteri, F. Masiero and C. Orrieri, Stochastic maximum principle for SPDEs with delay, Stochastic Process. Appl., 127 (2017), 2396-2427.  doi: 10.1016/j.spa.2016.11.007.  Google Scholar

[15]

R. F. Hartl, Optimal dynamic advertising policies for hereditary processes, J. Optim. Theory Appl., 43 (1984), 51-72.  doi: 10.1007/BF00934746.  Google Scholar

[16]

Y. Hu and S. Peng, Maximum principle for semilinear stochastic evolution control systems, Stochastics Stochastics Rep., 33 (1990), 159-180.  doi: 10.1080/17442509008833671.  Google Scholar

[17]

Y. Hu and S. Peng, Maximum principle for optimal control of stochastic system of functional type, Stochastic Anal. Appl., 14 (1996), 283-301.  doi: 10.1080/07362999608809440.  Google Scholar

[18]

S.-E. A. Mohammed, Stochastic differential systems with memory: Theory, examples and applications. Stochastic analysis and related topics VI, Progr. Probab., Birkhäuser Boston, Boston, MA, 42 (1998), 1–77.  Google Scholar

[19]

B. Øksendal, A. Sulem and T. Zhang, Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations, Adv. in Appl. Probab., 43 (2011), 572-596.  doi: 10.1239/aap/1308662493.  Google Scholar

[20]

C. Orrieri, E. Rocca and L. Scarpa, Optimal control of stochastic phase-field models related to tumor growth, ESAIM Control Optim. Calc. Var., forthcoming. doi: 10.1051/cocv/2020022.  Google Scholar

[21]

E. Pardoux and A. Răşcanu, Stochastic Differential Equations, Backward SDEs, Partial Differential Equations, Stochastic Modelling and Applied Probability, Springer, Cham, 2014. doi: 10.1007/978-3-319-05714-9.  Google Scholar

[22]

S. Peng and Z. Yang, Anticipated backward stochastic differential equations, Ann. Probab., 37 (2009), 877-902.  doi: 10.1214/08-AOP423.  Google Scholar

[23]

Z. Yang and R. J. Elliott, Some properties of generalized anticipated backward stochastic differential equations, Electron. Commun. Probab., 18 (2013), 10. doi: 10.1214/ECP.v18-2415.  Google Scholar

[24]

J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, New York, Springer-Verlag, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar

[1]

Yueyang Zheng, Jingtao Shi. A stackelberg game of backward stochastic differential equations with partial information. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020047
[2]

Qingfeng Zhu, Yufeng Shi. Nonzero-sum differential game of backward doubly stochastic systems with delay and applications. Mathematical Control & Related Fields, 2021, 11 (1) : 73-94. doi: 10.3934/mcrf.2020028
[3]

Fathalla A. Rihan, Hebatallah J. Alsakaji. Stochastic delay differential equations of three-species prey-predator system with cooperation among prey species. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020468
[4]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264
[5]

Editorial Office. Retraction: Xiao-Qian Jiang and Lun-Chuan Zhang, A pricing option approach based on backward stochastic differential equation theory. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 969-969. doi: 10.3934/dcdss.2019065
[6]

Bixiang Wang. Mean-square random invariant manifolds for stochastic differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1449-1468. doi: 10.3934/dcds.2020324
[7]

Fabio Camilli, Giulia Cavagnari, Raul De Maio, Benedetto Piccoli. Superposition principle and schemes for measure differential equations. Kinetic & Related Models, 2021, 14 (1) : 89-113. doi: 10.3934/krm.2020050
[8]

Stefan Doboszczak, Manil T. Mohan, Sivaguru S. Sritharan. Pontryagin maximum principle for the optimal control of linearized compressible navier-stokes equations with state constraints. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020110
[9]

Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133
[10]

Zhenzhen Wang, Tianshou Zhou. Asymptotic behaviors and stochastic traveling waves in stochastic Fisher-KPP equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020323
[11]

Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020317
[12]

Tetsuya Ishiwata, Young Chol Yang. Numerical and mathematical analysis of blow-up problems for a stochastic differential equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 909-918. doi: 10.3934/dcdss.2020391
[13]

Stefan Ruschel, Serhiy Yanchuk. The spectrum of delay differential equations with multiple hierarchical large delays. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 151-175. doi: 10.3934/dcdss.2020321
[14]

John Mallet-Paret, Roger D. Nussbaum. Asymptotic homogenization for delay-differential equations and a question of analyticity. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3789-3812. doi: 10.3934/dcds.2020044
[15]

Mugen Huang, Moxun Tang, Jianshe Yu, Bo Zheng. A stage structured model of delay differential equations for Aedes mosquito population suppression. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3467-3484. doi: 10.3934/dcds.2020042
[16]

Xuhui Peng, Rangrang Zhang. Approximations of stochastic 3D tamed Navier-Stokes equations. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5337-5365. doi: 10.3934/cpaa.2020241
[17]

Christian Beck, Lukas Gonon, Martin Hutzenthaler, Arnulf Jentzen. On existence and uniqueness properties for solutions of stochastic fixed point equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020320
[18]

Yangrong Li, Shuang Yang, Qiangheng Zhang. Odd random attractors for stochastic non-autonomous Kuramoto-Sivashinsky equations without dissipation. Electronic Research Archive, 2020, 28 (4) : 1529-1544. doi: 10.3934/era.2020080
[19]

Pengyu Chen. Non-autonomous stochastic evolution equations with nonlinear noise and nonlocal conditions governed by noncompact evolution families. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020383
[20]

Lin Shi, Xuemin Wang, Dingshi Li. Limiting behavior of non-autonomous stochastic reaction-diffusion equations with colored noise on unbounded thin domains. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5367-5386. doi: 10.3934/cpaa.2020242

2019 Impact Factor: 0.857

Tools

Article outline

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences