January  2017, 2: 1 doi: 10.1186/s41546-017-0014-7

Stochastic global maximum principle for optimization with recursive utilities

Zhongtai Institute of Finance, Shandong University, Jinan, Shandong 250100, People's Republic of China

Received  September 19, 2016 Revised  January 05, 2017

Fund Project: supported by NSF (No. 11671231, 11201262 and 10921101), Shandong Province (No.BS2013SF020 and ZR2014AP005), Young Scholars Program of Shandong University and the 111 Project (No. B12023).

In this paper, we study the recursive stochastic optimal control problems. The control domain does not need to be convex, and the generator of the backward stochastic differential equation can contain z. We obtain the variational equations for backward stochastic differential equations, and then obtain the maximum principle which solves completely Peng's open problem.
Citation: Mingshang Hu. Stochastic global maximum principle for optimization with recursive utilities. Probability, Uncertainty and Quantitative Risk, 2017, 2 (0) : 1-. doi: 10.1186/s41546-017-0014-7
References:
[1]

Briand, PH, Delyon, B, Hu, Y, Pardoux, E, Stoica, L:Lp solutions of backward stochastic differential equations. Stochastic Process. Appl. 108, 109-129 (2003),

[2]

Chen, Z, Epstein, L:Ambiguity, risk, and asset returns in continuous time. Econometrica 70, 1403-1443(2002),

[3]

Dokuchaev, M, Zhou, XY:Stochastic controls with terminal contingent conditions. J. Math. Anal. Appl. 238, 143-165 (1999),

[4]

Duffie, D, Epstein, L:Stochastic differential utility. Econometrica 60, 353-394 (1992),

[5]

El Karoui, N, Peng, S, Quenez, MC:Backward stochastic differential equations in finance. Math. Finance 7, 1-71 (1997),

[6]

El Karoui, N, Peng, S, Quenez, MC:A dynamic maximum priciple for the optimization of recursive utilities under constraints. Ann. Appl. Probab. 11, 664-693 (2001),

[7]

Ji, S, Zhou, XY:A maximum principle for stochastic optimal control with terminal state constrains, and its applications. Comm. Inf. Syst. 6, 321-337 (2006),

[8]

Kohlmann, M, Zhou, XY:Relationship between backward stochastic differential equations and stochastic controls:a linear-quadratic approach. SIAM J. Control Optim. 38, 1392-1407 (2000),

[9]

Lim, A, Zhou, XY:Linear-quadratic control of backward stochastic differential equations. SIAM J.Control Optim. 40, 450-474 (2001),

[10]

Pardoux, E, Peng, S:Adapted Solutions of Backward Stochastic Equations. Systerm Control Lett. 14, 55-61 (1990),

[11]

Peng, S:A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28, 966-979 (1990),

[12]

Peng, S:Backward stochastic differential equations and applications to optimal control. Appl. Math.Optim. 27, 125-144 (1993),

[13]

Peng, S:Open problems on backward stochastic differential equations. In:Chen, S, Li, X, Yong, J, Zhou, XY (eds.) Control of distributed parameter and stocastic systems, pp. 265-273, Boston:Kluwer Acad.Pub. (1998),

[14]

Shi, J, Wu, Z:The maximum principle for fully coupled forward-backward stochastic control system. Acta Automat. Sinica 32, 161-169 (2006),

[15]

Tang, S, Li, X:Necessary conditions for optimal control of stochastic systems with random jumps. SIAM J. Control Optim. 32, 1447-1475 (1994),

[16]

Wu, Z:Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems. Syst. Sci. Math. Sci. 11, 249-259 (1998),

[17]

Wu, Z:A general maximum principle for optimal control of forward-backward stochastic systems.Automatica 49, 1473-1480 (2013),

[18]

Xu, W:Stochastic maximum principle for optimal control problem of forward and backward system. J.Austral. Math. Soc. Ser. B 37, 172-185 (1995),

[19]

Yong, J:Optimality variational principle for controlled forward-backward stochastic differential equations with mixed initial-terminal conditions. SIAM J. Control Optim. 48, 4119-4156 (2010),

[20]

Yong, J, Zhou, XY:Stochastic controls:Hamiltonian systems and HJB equations. Springer-Verlag, New York (1999),

show all references

References:
[1]

Briand, PH, Delyon, B, Hu, Y, Pardoux, E, Stoica, L:Lp solutions of backward stochastic differential equations. Stochastic Process. Appl. 108, 109-129 (2003),

[2]

Chen, Z, Epstein, L:Ambiguity, risk, and asset returns in continuous time. Econometrica 70, 1403-1443(2002),

[3]

Dokuchaev, M, Zhou, XY:Stochastic controls with terminal contingent conditions. J. Math. Anal. Appl. 238, 143-165 (1999),

[4]

Duffie, D, Epstein, L:Stochastic differential utility. Econometrica 60, 353-394 (1992),

[5]

El Karoui, N, Peng, S, Quenez, MC:Backward stochastic differential equations in finance. Math. Finance 7, 1-71 (1997),

[6]

El Karoui, N, Peng, S, Quenez, MC:A dynamic maximum priciple for the optimization of recursive utilities under constraints. Ann. Appl. Probab. 11, 664-693 (2001),

[7]

Ji, S, Zhou, XY:A maximum principle for stochastic optimal control with terminal state constrains, and its applications. Comm. Inf. Syst. 6, 321-337 (2006),

[8]

Kohlmann, M, Zhou, XY:Relationship between backward stochastic differential equations and stochastic controls:a linear-quadratic approach. SIAM J. Control Optim. 38, 1392-1407 (2000),

[9]

Lim, A, Zhou, XY:Linear-quadratic control of backward stochastic differential equations. SIAM J.Control Optim. 40, 450-474 (2001),

[10]

Pardoux, E, Peng, S:Adapted Solutions of Backward Stochastic Equations. Systerm Control Lett. 14, 55-61 (1990),

[11]

Peng, S:A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28, 966-979 (1990),

[12]

Peng, S:Backward stochastic differential equations and applications to optimal control. Appl. Math.Optim. 27, 125-144 (1993),

[13]

Peng, S:Open problems on backward stochastic differential equations. In:Chen, S, Li, X, Yong, J, Zhou, XY (eds.) Control of distributed parameter and stocastic systems, pp. 265-273, Boston:Kluwer Acad.Pub. (1998),

[14]

Shi, J, Wu, Z:The maximum principle for fully coupled forward-backward stochastic control system. Acta Automat. Sinica 32, 161-169 (2006),

[15]

Tang, S, Li, X:Necessary conditions for optimal control of stochastic systems with random jumps. SIAM J. Control Optim. 32, 1447-1475 (1994),

[16]

Wu, Z:Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems. Syst. Sci. Math. Sci. 11, 249-259 (1998),

[17]

Wu, Z:A general maximum principle for optimal control of forward-backward stochastic systems.Automatica 49, 1473-1480 (2013),

[18]

Xu, W:Stochastic maximum principle for optimal control problem of forward and backward system. J.Austral. Math. Soc. Ser. B 37, 172-185 (1995),

[19]

Yong, J:Optimality variational principle for controlled forward-backward stochastic differential equations with mixed initial-terminal conditions. SIAM J. Control Optim. 48, 4119-4156 (2010),

[20]

Yong, J, Zhou, XY:Stochastic controls:Hamiltonian systems and HJB equations. Springer-Verlag, New York (1999),

[1]

Yueyang Zheng, Jingtao Shi. A stackelberg game of backward stochastic differential equations with partial information. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020047

[2]

Stefan Doboszczak, Manil T. Mohan, Sivaguru S. Sritharan. Pontryagin maximum principle for the optimal control of linearized compressible navier-stokes equations with state constraints. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020110

[3]

Giuseppina Guatteri, Federica Masiero. Stochastic maximum principle for problems with delay with dependence on the past through general measures. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020048

[4]

Editorial Office. Retraction: Xiao-Qian Jiang and Lun-Chuan Zhang, A pricing option approach based on backward stochastic differential equation theory. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 969-969. doi: 10.3934/dcdss.2019065

[5]

Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133

[6]

Qingfeng Zhu, Yufeng Shi. Nonzero-sum differential game of backward doubly stochastic systems with delay and applications. Mathematical Control & Related Fields, 2021, 11 (1) : 73-94. doi: 10.3934/mcrf.2020028

[7]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264

[8]

Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020317

[9]

Tetsuya Ishiwata, Young Chol Yang. Numerical and mathematical analysis of blow-up problems for a stochastic differential equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 909-918. doi: 10.3934/dcdss.2020391

[10]

Bixiang Wang. Mean-square random invariant manifolds for stochastic differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1449-1468. doi: 10.3934/dcds.2020324

[11]

Fabio Camilli, Giulia Cavagnari, Raul De Maio, Benedetto Piccoli. Superposition principle and schemes for measure differential equations. Kinetic & Related Models, 2021, 14 (1) : 89-113. doi: 10.3934/krm.2020050

[12]

Jingrui Sun, Hanxiao Wang. Mean-field stochastic linear-quadratic optimal control problems: Weak closed-loop solvability. Mathematical Control & Related Fields, 2021, 11 (1) : 47-71. doi: 10.3934/mcrf.2020026

[13]

Fathalla A. Rihan, Hebatallah J. Alsakaji. Stochastic delay differential equations of three-species prey-predator system with cooperation among prey species. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020468

[14]

Zhenzhen Wang, Tianshou Zhou. Asymptotic behaviors and stochastic traveling waves in stochastic Fisher-KPP equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020323

[15]

Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020107

[16]

Yuan Tan, Qingyuan Cao, Lan Li, Tianshi Hu, Min Su. A chance-constrained stochastic model predictive control problem with disturbance feedback. Journal of Industrial & Management Optimization, 2021, 17 (1) : 67-79. doi: 10.3934/jimo.2019099

[17]

Reza Chaharpashlou, Abdon Atangana, Reza Saadati. On the fuzzy stability results for fractional stochastic Volterra integral equation. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020432

[18]

Shang Wu, Pengfei Xu, Jianhua Huang, Wei Yan. Ergodicity of stochastic damped Ostrovsky equation driven by white noise. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1615-1626. doi: 10.3934/dcdsb.2020175

[19]

Christian Clason, Vu Huu Nhu, Arnd Rösch. Optimal control of a non-smooth quasilinear elliptic equation. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020052

[20]

Xuhui Peng, Rangrang Zhang. Approximations of stochastic 3D tamed Navier-Stokes equations. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5337-5365. doi: 10.3934/cpaa.2020241

 Impact Factor: 

Metrics

  • PDF downloads (11)
  • HTML views (97)
  • Cited by (0)

Other articles
by authors

[Back to Top]