American Institute of Mathematical Sciences

Advanced
January  2019, 4: 1 doi: 10.1186/s41546-018-0035-x

Mixed deterministic and random optimal control of linear stochastic systems with quadratic costs

Ying Hu 1, and  Shanjian Tang 2,,

1. Univ Rennes, CNRS, IRMAR-UMR 6625, 35000 Rennes, France;

2. Department of Finance and Control Sciences, School of Mathematical Sciences, Fudan University, Shanghai, 200433 China

Received  November 26, 2018 Revised  December 11, 2018

Fund Project: Hu acknowledges research supported by Lebesgue center of mathematics "Investissements d'avenir" program-ANR-11-LABX-0020-01, by CAESARS-ANR-15-CE05-0024 and by MFG-ANR-16-CE40-0015-01. Tang acknowledges research supported by National Science Foundation of China (Grant No. 11631004) and Science and Technology Commission of Shanghai Municipality (Grant No. 14XD1400400).

In this paper, we consider the mixed optimal control of a linear stochastic system with a quadratic cost functional, with two controllers-one can choose only deterministic time functions, called the deterministic controller, while the other can choose adapted random processes, called the random controller. The optimal control is shown to exist under suitable assumptions. The optimal control is characterized via a system of fully coupled forward-backward stochastic differential equations (FBSDEs) of mean-field type. We solve the FBSDEs via solutions of two (but decoupled) Riccati equations, and give the respective optimal feedback law for both deterministic and random controllers, using solutions of both Riccati equations. The optimal state satisfies a linear stochastic differential equation (SDE) of mean-field type. Both the singular and infinite time-horizonal cases are also addressed.
Keywords: Stochastic LQ, Differential/algebraic Riccati equation, Mixed deterministic and random control, Singular LQ, Infinite-horizon.
Mathematics Subject Classification: 93E20.
Citation: Ying Hu, Shanjian Tang. Mixed deterministic and random optimal control of linear stochastic systems with quadratic costs. Probability, Uncertainty and Quantitative Risk, 2019, 4 (0) : 1-. doi: 10.1186/s41546-018-0035-x
References:
[1]

Bensoussan, A.:Lectures on stochastic control. In:Mitter, S.K., Moro, A. (eds.) Nonlinear filtering and stochastic control, Proceedings of the 3rd 1981 Session of the Centro Internazionale Matematico Estivo (C.I.M.E.), Held at Cortona, July 1-10, 1981 pp. 1-62. Lecture Notes in Mathematics 972. Springer-Verlag, Berlin (1982),

[2]

Bismut, J.M.:Linear quadratic optimal stochastic control with random coefficients. SIAM J. Control Optim. 14, 419-444(1976),

[3]

Buckdahn, R., Li, J., Peng, S.:Mean-field backward stochastic differential equations and related partial differential equations. Stoch. Process. Appl. 119, 3133-3154(2009),

[4]

Haussmann, U.G.:Optimal stationary control with state and control dependent noise. SIAM J. Control. 9, 184-198(1971),

[5]

Kohlmann, M., Tang, S.:Minimization of risk and linear quadratic optimal control theory. SIAM J. Control Optim. 42, 1118-1142(2003),

[6]

Peng, S.:Stochastic Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 30, 284-304(1992),

[7]

Tang, S.:General linear quadratic optimal stochastic control problems with random coefficients:linear stochastic Hamilton systems and backward stochastic Riccati equations. SIAM J. Control Optim. 42, 53-75(2003),

[8]

Wonham, W.M.:On a matrix Riccati equation of stochastic control. SIAM J. Control. 6, 681-697(1968),

[9]

Wu, H., Zhou, X.:Stochastic frequency characteristics. SIAM J. Control Optim. 40, 557-576(2001),

[10]

Yong, J., Zhou, X.Y.:Stochastic Controls:Hamiltonian Systems and HJB Equations. Springer-Verlag, New York (1999),

show all references

References:
[1]

Bensoussan, A.:Lectures on stochastic control. In:Mitter, S.K., Moro, A. (eds.) Nonlinear filtering and stochastic control, Proceedings of the 3rd 1981 Session of the Centro Internazionale Matematico Estivo (C.I.M.E.), Held at Cortona, July 1-10, 1981 pp. 1-62. Lecture Notes in Mathematics 972. Springer-Verlag, Berlin (1982),

[2]

Bismut, J.M.:Linear quadratic optimal stochastic control with random coefficients. SIAM J. Control Optim. 14, 419-444(1976),

[3]

Buckdahn, R., Li, J., Peng, S.:Mean-field backward stochastic differential equations and related partial differential equations. Stoch. Process. Appl. 119, 3133-3154(2009),

[4]

Haussmann, U.G.:Optimal stationary control with state and control dependent noise. SIAM J. Control. 9, 184-198(1971),

[5]

Kohlmann, M., Tang, S.:Minimization of risk and linear quadratic optimal control theory. SIAM J. Control Optim. 42, 1118-1142(2003),

[6]

Peng, S.:Stochastic Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 30, 284-304(1992),

[7]

Tang, S.:General linear quadratic optimal stochastic control problems with random coefficients:linear stochastic Hamilton systems and backward stochastic Riccati equations. SIAM J. Control Optim. 42, 53-75(2003),

[8]

Wonham, W.M.:On a matrix Riccati equation of stochastic control. SIAM J. Control. 6, 681-697(1968),

[9]

Wu, H., Zhou, X.:Stochastic frequency characteristics. SIAM J. Control Optim. 40, 557-576(2001),

[10]

Yong, J., Zhou, X.Y.:Stochastic Controls:Hamiltonian Systems and HJB Equations. Springer-Verlag, New York (1999),

[1]

Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020107
[2]

Bixiang Wang. Mean-square random invariant manifolds for stochastic differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1449-1468. doi: 10.3934/dcds.2020324
[3]

Ténan Yeo. Stochastic and deterministic SIS patch model. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2021012
[4]

Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020317
[5]

Tetsuya Ishiwata, Young Chol Yang. Numerical and mathematical analysis of blow-up problems for a stochastic differential equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 909-918. doi: 10.3934/dcdss.2020391
[6]

Junkee Jeon. Finite horizon portfolio selection problems with stochastic borrowing constraints. Journal of Industrial & Management Optimization, 2021, 17 (2) : 733-763. doi: 10.3934/jimo.2019132
[7]

Leanne Dong. Random attractors for stochastic Navier-Stokes equation on a 2D rotating sphere with stable Lévy noise. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020352
[8]

Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133
[9]

Yvjing Yang, Yang Liu, Jungang Lou, Zhen Wang. Observability of switched Boolean control networks using algebraic forms. Discrete & Continuous Dynamical Systems - S, 2021, 14 (4) : 1519-1533. doi: 10.3934/dcdss.2020373
[10]

Editorial Office. Retraction: Xiao-Qian Jiang and Lun-Chuan Zhang, A pricing option approach based on backward stochastic differential equation theory. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 969-969. doi: 10.3934/dcdss.2019065
[11]

Kerioui Nadjah, Abdelouahab Mohammed Salah. Stability and Hopf bifurcation of the coexistence equilibrium for a differential-algebraic biological economic system with predator harvesting. Electronic Research Archive, 2021, 29 (1) : 1641-1660. doi: 10.3934/era.2020084
[12]

Jianhua Huang, Yanbin Tang, Ming Wang. Singular support of the global attractor for a damped BBM equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020345
[13]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264
[14]

Max E. Gilmore, Chris Guiver, Hartmut Logemann. Sampled-data integral control of multivariable linear infinite-dimensional systems with input nonlinearities. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021001
[15]

Hui Lv, Xing'an Wang. Dissipative control for uncertain singular markovian jump systems via hybrid impulsive control. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 127-142. doi: 10.3934/naco.2020020
[16]

Feifei Cheng, Ji Li. Geometric singular perturbation analysis of Degasperis-Procesi equation with distributed delay. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 967-985. doi: 10.3934/dcds.2020305
[17]

Yukihiko Nakata. Existence of a period two solution of a delay differential equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1103-1110. doi: 10.3934/dcdss.2020392
[18]

Yueyang Zheng, Jingtao Shi. A stackelberg game of backward stochastic differential equations with partial information. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020047
[19]

Yangrong Li, Shuang Yang, Qiangheng Zhang. Odd random attractors for stochastic non-autonomous Kuramoto-Sivashinsky equations without dissipation. Electronic Research Archive, 2020, 28 (4) : 1529-1544. doi: 10.3934/era.2020080
[20]

Wenlong Sun, Jiaqi Cheng, Xiaoying Han. Random attractors for 2D stochastic micropolar fluid flows on unbounded domains. Discrete & Continuous Dynamical Systems - B, 2021, 26 (1) : 693-716. doi: 10.3934/dcdsb.2020189

 Impact Factor: 

Tools

Metrics

  • PDF downloads (12)
  • HTML views (83)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences