# American Institute of Mathematical Sciences

• Previous Article
Analysis of the Newsboy Problem subject to price dependent demand and multiple discounts
• JIMO Home
• This Issue
• Next Article
On optimality conditions and duality for non-differentiable interval-valued programming problems with the generalized (F, ρ)-convexity
July  2018, 14(3): 913-930. doi: 10.3934/jimo.2017082

## Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems

 1 School of Mathematics and Statistics, Xinyang Normal University, Xinyang, Henan 464000, China 2 School of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China

* Corresponding author: ygzhu@njust.edu.cn

Received  February 2016 Revised  August 2017 Published  September 2017

Fund Project: This work is supported by the National Natural Science Foundation of China (No.61673011), the Nanhu Scholars Program for Young Scholars of XYNU and the Key Scientific Research Project for Colleges and Universities of Henan Province (No.17A120013).

Uncertainty theory is a branch of axiomatic mathematics that deals with human uncertainty. Based on uncertainty theory, this paper discusses linear quadratic (LQ) optimal control with process state inequality constraints for discrete-time uncertain systems, where the weighting matrices in the cost function are assumed to be indefinite. By means of the maximum principle with mixed inequality constraints, we present a necessary condition for the existence of optimal state feedback control that involves a constrained difference equation. Moreover, the existence of a solution to the constrained difference equation is equivalent to the solvability of the indefinite LQ problem. Furthermore, the well-posedness of the indefinite LQ problem is proved. Finally, an example is provided to demonstrate the effectiveness of our theoretical results.

Citation: Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082
##### References:
 [1] M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606.  doi: 10.1016/S0019-9958(67)90803-0.  Google Scholar [2] K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378.  doi: 10.1007/s00245-007-9017-6.  Google Scholar [3] A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935.  doi: 10.1137/0322060.  Google Scholar [4] D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.  Google Scholar [5] S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702.  doi: 10.1137/S0363012996310478.  Google Scholar [6] X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123.  doi: 10.1007/s10700-012-9141-x.  Google Scholar [7] Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599.  doi: 10.1016/j.apm.2011.09.042.  Google Scholar [8] M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.  Google Scholar [9] Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466.  doi: 10.1137/S0363012904441969.  Google Scholar [10] D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.   Google Scholar [11] X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282.  doi: 10.4310/CIS.2002.v2.n3.a4.  Google Scholar [12] B. Liu, Uncertainty Theory 2nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.  Google Scholar [13] B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.  Google Scholar [14] B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.   Google Scholar [15] X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270.  doi: 10.1016/j.amc.2013.09.036.  Google Scholar [16] B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240.  doi: 10.1016/j.cie.2014.09.029.  Google Scholar [17] R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413.  doi: 10.1017/S0305004100030401.  Google Scholar [18] L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87.  doi: 10.1142/S0218488513400060.  Google Scholar [19] Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23.  doi: 10.1016/j.ejcon.2016.12.003.  Google Scholar [20] V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711.  doi: 10.1016/j.jmaa.2014.09.010.  Google Scholar [21] Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26.  doi: 10.3934/jimo.2015.11.13.  Google Scholar [22] W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697.  doi: 10.1137/0306044.  Google Scholar [23] H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282.  doi: 10.3934/jimo.2016016.  Google Scholar [24] J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar [25] W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642.  doi: 10.1109/TAC.2008.929368.  Google Scholar [26] W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94.  doi: 10.1016/j.automatica.2003.07.002.  Google Scholar [27] W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.  Google Scholar [28] X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33.  doi: 10.1007/s002450010003.  Google Scholar [29] Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547.  doi: 10.1080/01969722.2010.511552.  Google Scholar [30] Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.   Google Scholar

show all references

##### References:
 [1] M. Athans, The matrix minimum principle, Information and Control, 11 (1967), 592-606.  doi: 10.1016/S0019-9958(67)90803-0.  Google Scholar [2] K. Bahlali, B. Djehiche and B. Mezerdi, On the stochastic maximum principle in optimal control of degenerate diffusions with Lipschitz coefficients, Applied Mathematics and Optimization, 56 (2007), 364-378.  doi: 10.1007/s00245-007-9017-6.  Google Scholar [3] A. Bensoussan, S. P. Sethi, R. G. Vickson and N. Derzko, Stochastic production planning with production constraints: A summary, SIAM Journal on Control and Optimization, 22 (1984), 920-935.  doi: 10.1137/0322060.  Google Scholar [4] D. P. Bertsekas, Dynamic Programming and Stochastic Control, Mathematics in Science and Engineering, 125. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.  Google Scholar [5] S. P. Chen, X. J. Li and X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization, 36 (1998), 1685-1702.  doi: 10.1137/S0363012996310478.  Google Scholar [6] X. Chen, Y. Liu and D. A. Ralescu, Uncertain stock model with periodic dividends, Fuzzy Optimization and Decision Making, 12 (2013), 111-123.  doi: 10.1007/s10700-012-9141-x.  Google Scholar [7] Y. Gao, Uncertain models for single facility location problems on networks, Applied Mathematical Modelling, 36 (2012), 2592-2599.  doi: 10.1016/j.apm.2011.09.042.  Google Scholar [8] M. R. Hestenes, Calculus of Variations and Optimal Control Theory Wiley, New York, 1966.  Google Scholar [9] Y. Hu and X. Y. Zhou, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 44 (2005), 444-466.  doi: 10.1137/S0363012904441969.  Google Scholar [10] D. Kahneman and A. Tversky, Prospect theory: an analysis of decision under risk, Econometrica, 47 (1979), 263-292.   Google Scholar [11] X. Li and X. Y. Zhou, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications on Information and Systems, 2 (2002), 265-282.  doi: 10.4310/CIS.2002.v2.n3.a4.  Google Scholar [12] B. Liu, Uncertainty Theory 2nd edition, Springer-Verlag, Berlin, 2004. doi: 10.1007/978-3-540-39987-2.  Google Scholar [13] B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty Springer-Verlag, Heidelberg, 2015. doi: 10.1007/978-3-662-44354-5.  Google Scholar [14] B. Liu, Some research problems in uncertainty theory, Journal of Uncertain Systems, 3 (2009), 3-10.   Google Scholar [15] X. Liu, Y. Li and W. Zhang, Stochastic linear quadratic optimal control with constraint for discrete-time systems, Applied Mathematics and Computation, 228 (2014), 264-270.  doi: 10.1016/j.amc.2013.09.036.  Google Scholar [16] B. Liu and K. Yao, Uncertain multilevel programming: Algorithm and applications, Computers and Industrial Engineering, 89 (2014), 235-240.  doi: 10.1016/j.cie.2014.09.029.  Google Scholar [17] R. Penrose, A generalized inverse of matrices, Mathematical Proceedings of the Cambridge Philosophical Society, 51 (1955), 406-413.  doi: 10.1017/S0305004100030401.  Google Scholar [18] L. Sheng and Y. Zhu, Optimistic value model of uncertain optimal control, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 21 (2013), 75-87.  doi: 10.1142/S0218488513400060.  Google Scholar [19] Y. Shu and Y. Zhu, Stability and optimal control for uncertain continuous-time singular systems, European Journal of Control, 34 (2017), 16-23.  doi: 10.1016/j.ejcon.2016.12.003.  Google Scholar [20] V. K. Socgnia and O. Menoukeu-Pamen, An infinite horizon stochastic maximum principle for discounted control problem with Lipschitz coefficients, Journal of Mathematical Analysis and Applications, 422 (2015), 684-711.  doi: 10.1016/j.jmaa.2014.09.010.  Google Scholar [21] Z. Wang, J. Guo, M. Zheng and Y. Yang, A new approach for uncertain multiobjective programming problem based on $\mathcal{P}_E$ principle, Journal of Industrial and Management Optimization, 11 (2015), 13-26.  doi: 10.3934/jimo.2015.11.13.  Google Scholar [22] W. M. Wonham, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization, 6 (1968), 681-697.  doi: 10.1137/0306044.  Google Scholar [23] H. Yan, Y. Sun and Y. Zhu, A linear-quadratic control problem of uncertain discrete-time switched systems, Journal of Industrial and Management Optimization, 13 (2017), 267-282.  doi: 10.3934/jimo.2016016.  Google Scholar [24] J. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations Springer, New York, 1999. doi: 10.1007/978-1-4612-1466-3.  Google Scholar [25] W. Zhang, H. Zhang and B. S. Chen, Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion, IEEE Transactions on Automatic Control, 53 (2008), 1630-1642.  doi: 10.1109/TAC.2008.929368.  Google Scholar [26] W. Zhang and B. S. Chen, On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40 (2004), 87-94.  doi: 10.1016/j.automatica.2003.07.002.  Google Scholar [27] W. Zhang and G. Li, Discrete-time indefinite stochastic linear quadratic optimal control with second moment constraints Mathematical Problems in Engineering 2014 (2014), Art. ID 278142, 9 pp. doi: 10.1155/2014/278142.  Google Scholar [28] X. Y. Zhou and D. Li, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 42 (2000), 19-33.  doi: 10.1007/s002450010003.  Google Scholar [29] Y. Zhu, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal, 41 (2010), 535-547.  doi: 10.1080/01969722.2010.511552.  Google Scholar [30] Y. Zhu, Functions of uncertain variables and uncertain programming, Journal of Uncertain Systems, 6 (2012), 278-288.   Google Scholar
 [1] Elena K. Kostousova. External polyhedral estimates of reachable sets of discrete-time systems with integral bounds on additive terms. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021015 [2] Tadeusz Kaczorek, Andrzej Ruszewski. Analysis of the fractional descriptor discrete-time linear systems by the use of the shuffle algorithm. Journal of Computational Dynamics, 2021  doi: 10.3934/jcd.2021007 [3] Horst R. Thieme. Discrete-time dynamics of structured populations via Feller kernels. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021082 [4] Alberto Bressan, Ke Han, Franco Rampazzo. On the control of non holonomic systems by active constraints. Discrete & Continuous Dynamical Systems, 2013, 33 (8) : 3329-3353. doi: 10.3934/dcds.2013.33.3329 [5] Lifen Jia, Wei Dai. Uncertain spring vibration equation. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021073 [6] Paula A. González-Parra, Sunmi Lee, Leticia Velázquez, Carlos Castillo-Chavez. A note on the use of optimal control on a discrete time model of influenza dynamics. Mathematical Biosciences & Engineering, 2011, 8 (1) : 183-197. doi: 10.3934/mbe.2011.8.183 [7] Xiaozhong Yang, Xinlong Liu. Numerical analysis of two new finite difference methods for time-fractional telegraph equation. Discrete & Continuous Dynamical Systems - B, 2021, 26 (7) : 3921-3942. doi: 10.3934/dcdsb.2020269 [8] Elimhan N. Mahmudov. Second order discrete time-varying and time-invariant linear continuous systems and Kalman type conditions. Numerical Algebra, Control & Optimization, 2021  doi: 10.3934/naco.2021010 [9] Tobias Geiger, Daniel Wachsmuth, Gerd Wachsmuth. Optimal control of ODEs with state suprema. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021012 [10] Xiaohong Li, Mingxin Sun, Zhaohua Gong, Enmin Feng. Multistage optimal control for microbial fed-batch fermentation process. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021040 [11] Fabio Camilli, Serikbolsyn Duisembay, Qing Tang. Approximation of an optimal control problem for the time-fractional Fokker-Planck equation. Journal of Dynamics & Games, 2021  doi: 10.3934/jdg.2021013 [12] Manuel de León, Víctor M. Jiménez, Manuel Lainz. Contact Hamiltonian and Lagrangian systems with nonholonomic constraints. Journal of Geometric Mechanics, 2021, 13 (1) : 25-53. doi: 10.3934/jgm.2021001 [13] Guirong Jiang, Qishao Lu. The dynamics of a Prey-Predator model with impulsive state feedback control. Discrete & Continuous Dynamical Systems - B, 2006, 6 (6) : 1301-1320. doi: 10.3934/dcdsb.2006.6.1301 [14] Rabiaa Ouahabi, Nasr-Eddine Hamri. Design of new scheme adaptive generalized hybrid projective synchronization for two different chaotic systems with uncertain parameters. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2361-2370. doi: 10.3934/dcdsb.2020182 [15] Pengfei Wang, Mengyi Zhang, Huan Su. Input-to-state stability of infinite-dimensional stochastic nonlinear systems. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021066 [16] Peng Zhang, Yongquan Zeng, Guotai Chi. Time-consistent multiperiod mean semivariance portfolio selection with the real constraints. Journal of Industrial & Management Optimization, 2021, 17 (4) : 1663-1680. doi: 10.3934/jimo.2020039 [17] Claudianor O. Alves, Giovany M. Figueiredo, Riccardo Molle. Multiple positive bound state solutions for a critical Choquard equation. Discrete & Continuous Dynamical Systems, 2021  doi: 10.3934/dcds.2021061 [18] Sumon Sarkar, Bibhas C. Giri. Optimal lot-sizing policy for a failure prone production system with investment in process quality improvement and lead time variance reduction. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021048 [19] Bingru Zhang, Chuanye Gu, Jueyou Li. Distributed convex optimization with coupling constraints over time-varying directed graphs†. Journal of Industrial & Management Optimization, 2021, 17 (4) : 2119-2138. doi: 10.3934/jimo.2020061 [20] Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437

2019 Impact Factor: 1.366