# American Institute of Mathematical Sciences

April  2016, 12(2): 471-486. doi: 10.3934/jimo.2016.12.471

## $p$th Moment absolute exponential stability of stochastic control system with Markovian switching

 1 Department of Mathematics, College of Science, China University of Petroleum, Beijing 102249, China, China, China, China

Received  September 2014 Revised  February 2015 Published  June 2015

In this paper we discuss the $p$th moment absolute exponential stability of stochastic control system with Markovian switching. We first give a new concept of $p$th moment absolute exponential stability, then we establish some theorems under different hypotheses to guarantee the system $p$th moment absolutely exponentially stable. These sufficient conditions in our theorems are algebraic criteria in terms of matrix inequalities, and we introduce an $M$-method with MATLAB to compute them. Finally, some examples are given to illustrate our results.
Citation: Yi Zhang, Yuyun Zhao, Tao Xu, Xin Liu. $p$th Moment absolute exponential stability of stochastic control system with Markovian switching. Journal of Industrial & Management Optimization, 2016, 12 (2) : 471-486. doi: 10.3934/jimo.2016.12.471
##### References:
 [1] G. K. Basak, A. Bisi and M. K. Ghosh, Stability of a random diffusion with linear drift,, Journal of Mathematical Analysis and Applications, 202 (1996), 604. doi: 10.1006/jmaa.1996.0336. [2] V. A. Brusin and V. A. Ugrinovskii, Stochastic stability of a class of nonlinear differential equations of Ito type,, Siberian Mathematical Journal, 28 (1987), 381. [3] C. Jiang, K. L. Teo, R. Loxton and G. R. Duan, A neighboring extremal solution for an optimal switched impulsive control problem,, Journal of Industrial and Management Optimization, 8 (2012), 591. doi: 10.3934/jimo.2012.8.591. [4] R. E. Kalman, Lyapunov functions for the problem of Lur'e in automatic control,, Proceedings of the National Academy of Sciences of the United States of America, 49 (1963). doi: 10.1073/pnas.49.2.201. [5] D. G. Korenevskii, Algebraic criteria for absolute (relative to nonlinearity) stability of stochastic automatic control systems with nonlinear feedback,, Ukrainian Mathematical Journal, 40 (1988), 616. doi: 10.1007/BF01057179. [6] H. J. Kushner, Stochastic Stability and Control, volume 33 of Mathematics in Science and Engineering,, Academic Press, (1967). [7] X. Liao, L. Q. Wang and P. Yu, Stability of Dynamical Systems,, Elsevier, (2007). doi: 10.1016/S1574-6917(07)05001-5. [8] X. Liao and P. Yu, Absolute Stability of Nonlinear Control Systems,, 2nd edition, (2008). doi: 10.1007/978-1-4020-8482-9. [9] D. Liberzon, Switching in Systems and Control,, Springer, (2003). doi: 10.1007/978-1-4612-0017-8. [10] M. R. Liberzon, Essays on the absolute stability theory,, Automation and Remote Control, 67 (2006), 1610. doi: 10.1134/S0005117906100043. [11] A. I. Lurie and V. N. Postnikov, On the theory of stability of control systems,, Applied Mathematics and Mechanics, 8 (1944), 246. [12] A. K. Mahalanabis and S. Purkayastha, Frequency-domain criteria for stability of a class of nonlinear stochastic systems,, Automatic Control, 18 (1973), 266. [13] L. Li, Y. Gao and H. Wang, Second order sufficient optimality conditions for hybrid control problems with state jump,, Journal of Industrial and Management Optimization, 11 (2015), 329. doi: 10.3934/jimo.2015.11.329. [14] X. Mao, Stability of stochastic differential equations with Markovian switching,, Stochastic Processes and Their Applications, 79 (1999), 45. doi: 10.1016/S0304-4149(98)00070-2. [15] X. Mao, Asymptotic stability for stochastic differential equations with Markovian switching,, WSEAS Trans. Circuits, 1 (2002), 68. [16] X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching,, Imperial College Press, (2006). doi: 10.1142/p473. [17] X. Mao, Stochastic Differential Equations and Applications,, Elsevier, (2007). doi: 10.1533/9780857099402. [18] P. V. Pakshin and V. A. Ugrinovskii, Stochastic problems of absolute stability,, Automation and Remote Control, 67 (2006), 1811. doi: 10.1134/S0005117906110051. [19] V. M. Popov, Absolute stability of nonlinear systems of automatic control,, Automation and Remote Control, 22 (1962), 857. [20] Z. Sun and S. Ge, Stability Theory of Switched Dynamical Systems,, Springer, (2011). doi: 10.1007/978-0-85729-256-8. [21] A. J. Van Der Schaft and J. M. Schumacher, An Introduction to Hybrid Dynamical Systems,, Springer, (2000). doi: 10.1007/BFb0109998. [22] H. Xie, Theory and Application of Absolute Stability,, Science Press, (1986). [23] H. Xu and K. L. Teo, Exponential stability with-gain condition of nonlinear impulsive switched systems,, Automatic Control, 55 (2010), 2429. doi: 10.1109/TAC.2010.2060173. [24] H. Xu, K. L. Teo and W. Gui, Necessary and sufficient conditions for stability of impulsive switched linear systems,, Discrete and Continuous Dynamical Systems-Series B, 16 (2011), 1185. doi: 10.3934/dcdsb.2011.16.1185. [25] X. Xie, H. Xu and R. Zhang, Exponential stabilization of impulsive switched systems with time delays using guaranteed cost control,, Abstract and Applied Analysis, 2014 (2014). doi: 10.1155/2014/126836. [26] V. A. Yakubovich, The solution of certain matrix inequalities in automatic control theory,, Soviet Math. Dokl, 3 (1962), 620. [27] Y. Zhang, M. Wang, H. Xu and K. L. Teo, Global stabilization of switched control systems with time delay,, Nonlinear Analysis: Hybrid Systems, 14 (2014), 86. doi: 10.1016/j.nahs.2014.05.004. [28] Y. Zhang, Y. Zhao, H. Xu, H. Shi and K. L. Teo, On boundedness and attractiveness of nonlinear switched delay systems,, In Abstract and Applied Analysis, 2013 (2013).

show all references

##### References:
 [1] G. K. Basak, A. Bisi and M. K. Ghosh, Stability of a random diffusion with linear drift,, Journal of Mathematical Analysis and Applications, 202 (1996), 604. doi: 10.1006/jmaa.1996.0336. [2] V. A. Brusin and V. A. Ugrinovskii, Stochastic stability of a class of nonlinear differential equations of Ito type,, Siberian Mathematical Journal, 28 (1987), 381. [3] C. Jiang, K. L. Teo, R. Loxton and G. R. Duan, A neighboring extremal solution for an optimal switched impulsive control problem,, Journal of Industrial and Management Optimization, 8 (2012), 591. doi: 10.3934/jimo.2012.8.591. [4] R. E. Kalman, Lyapunov functions for the problem of Lur'e in automatic control,, Proceedings of the National Academy of Sciences of the United States of America, 49 (1963). doi: 10.1073/pnas.49.2.201. [5] D. G. Korenevskii, Algebraic criteria for absolute (relative to nonlinearity) stability of stochastic automatic control systems with nonlinear feedback,, Ukrainian Mathematical Journal, 40 (1988), 616. doi: 10.1007/BF01057179. [6] H. J. Kushner, Stochastic Stability and Control, volume 33 of Mathematics in Science and Engineering,, Academic Press, (1967). [7] X. Liao, L. Q. Wang and P. Yu, Stability of Dynamical Systems,, Elsevier, (2007). doi: 10.1016/S1574-6917(07)05001-5. [8] X. Liao and P. Yu, Absolute Stability of Nonlinear Control Systems,, 2nd edition, (2008). doi: 10.1007/978-1-4020-8482-9. [9] D. Liberzon, Switching in Systems and Control,, Springer, (2003). doi: 10.1007/978-1-4612-0017-8. [10] M. R. Liberzon, Essays on the absolute stability theory,, Automation and Remote Control, 67 (2006), 1610. doi: 10.1134/S0005117906100043. [11] A. I. Lurie and V. N. Postnikov, On the theory of stability of control systems,, Applied Mathematics and Mechanics, 8 (1944), 246. [12] A. K. Mahalanabis and S. Purkayastha, Frequency-domain criteria for stability of a class of nonlinear stochastic systems,, Automatic Control, 18 (1973), 266. [13] L. Li, Y. Gao and H. Wang, Second order sufficient optimality conditions for hybrid control problems with state jump,, Journal of Industrial and Management Optimization, 11 (2015), 329. doi: 10.3934/jimo.2015.11.329. [14] X. Mao, Stability of stochastic differential equations with Markovian switching,, Stochastic Processes and Their Applications, 79 (1999), 45. doi: 10.1016/S0304-4149(98)00070-2. [15] X. Mao, Asymptotic stability for stochastic differential equations with Markovian switching,, WSEAS Trans. Circuits, 1 (2002), 68. [16] X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching,, Imperial College Press, (2006). doi: 10.1142/p473. [17] X. Mao, Stochastic Differential Equations and Applications,, Elsevier, (2007). doi: 10.1533/9780857099402. [18] P. V. Pakshin and V. A. Ugrinovskii, Stochastic problems of absolute stability,, Automation and Remote Control, 67 (2006), 1811. doi: 10.1134/S0005117906110051. [19] V. M. Popov, Absolute stability of nonlinear systems of automatic control,, Automation and Remote Control, 22 (1962), 857. [20] Z. Sun and S. Ge, Stability Theory of Switched Dynamical Systems,, Springer, (2011). doi: 10.1007/978-0-85729-256-8. [21] A. J. Van Der Schaft and J. M. Schumacher, An Introduction to Hybrid Dynamical Systems,, Springer, (2000). doi: 10.1007/BFb0109998. [22] H. Xie, Theory and Application of Absolute Stability,, Science Press, (1986). [23] H. Xu and K. L. Teo, Exponential stability with-gain condition of nonlinear impulsive switched systems,, Automatic Control, 55 (2010), 2429. doi: 10.1109/TAC.2010.2060173. [24] H. Xu, K. L. Teo and W. Gui, Necessary and sufficient conditions for stability of impulsive switched linear systems,, Discrete and Continuous Dynamical Systems-Series B, 16 (2011), 1185. doi: 10.3934/dcdsb.2011.16.1185. [25] X. Xie, H. Xu and R. Zhang, Exponential stabilization of impulsive switched systems with time delays using guaranteed cost control,, Abstract and Applied Analysis, 2014 (2014). doi: 10.1155/2014/126836. [26] V. A. Yakubovich, The solution of certain matrix inequalities in automatic control theory,, Soviet Math. Dokl, 3 (1962), 620. [27] Y. Zhang, M. Wang, H. Xu and K. L. Teo, Global stabilization of switched control systems with time delay,, Nonlinear Analysis: Hybrid Systems, 14 (2014), 86. doi: 10.1016/j.nahs.2014.05.004. [28] Y. Zhang, Y. Zhao, H. Xu, H. Shi and K. L. Teo, On boundedness and attractiveness of nonlinear switched delay systems,, In Abstract and Applied Analysis, 2013 (2013).
 [1] Fuke Wu, George Yin, Le Yi Wang. Razumikhin-type theorems on moment exponential stability of functional differential equations involving two-time-scale Markovian switching. Mathematical Control & Related Fields, 2015, 5 (3) : 697-719. doi: 10.3934/mcrf.2015.5.697 [2] Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete & Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011 [3] Yaozhong Hu, David Nualart, Xiaobin Sun, Yingchao Xie. Smoothness of density for stochastic differential equations with Markovian switching. Discrete & Continuous Dynamical Systems - B, 2017, 22 (11) : 1-17. doi: 10.3934/dcdsb.2018307 [4] Henri Schurz. Moment attractivity, stability and contractivity exponents of stochastic dynamical systems. Discrete & Continuous Dynamical Systems - A, 2001, 7 (3) : 487-515. doi: 10.3934/dcds.2001.7.487 [5] Tomás Caraballo, José Real, T. Taniguchi. The exponential stability of neutral stochastic delay partial differential equations. Discrete & Continuous Dynamical Systems - A, 2007, 18 (2&3) : 295-313. doi: 10.3934/dcds.2007.18.295 [6] Min Zhu, Panpan Ren, Junping Li. Exponential stability of solutions for retarded stochastic differential equations without dissipativity. Discrete & Continuous Dynamical Systems - B, 2017, 22 (7) : 2923-2938. doi: 10.3934/dcdsb.2017157 [7] Syvert P. Nørsett, Andreas Asheim. Regarding the absolute stability of Størmer-Cowell methods. Discrete & Continuous Dynamical Systems - A, 2014, 34 (3) : 1131-1146. doi: 10.3934/dcds.2014.34.1131 [8] Elena Braverman, Sergey Zhukovskiy. Absolute and delay-dependent stability of equations with a distributed delay. Discrete & Continuous Dynamical Systems - A, 2012, 32 (6) : 2041-2061. doi: 10.3934/dcds.2012.32.2041 [9] Jian Chen, Tao Zhang, Ziye Zhang, Chong Lin, Bing Chen. Stability and output feedback control for singular Markovian jump delayed systems. Mathematical Control & Related Fields, 2018, 8 (2) : 475-490. doi: 10.3934/mcrf.2018019 [10] Guangliang Zhao, Fuke Wu, George Yin. Feedback controls to ensure global solutions and asymptotic stability of Markovian switching diffusion systems. Mathematical Control & Related Fields, 2015, 5 (2) : 359-376. doi: 10.3934/mcrf.2015.5.359 [11] Yong Ren, Xuejuan Jia, Lanying Hu. Exponential stability of solutions to impulsive stochastic differential equations driven by $G$-Brownian motion. Discrete & Continuous Dynamical Systems - B, 2015, 20 (7) : 2157-2169. doi: 10.3934/dcdsb.2015.20.2157 [12] Yong Ren, Huijin Yang, Wensheng Yin. Weighted exponential stability of stochastic coupled systems on networks with delay driven by $G$-Brownian motion. Discrete & Continuous Dynamical Systems - B, 2019, 24 (7) : 3379-3393. doi: 10.3934/dcdsb.2018325 [13] Evelyn Buckwar, Girolama Notarangelo. A note on the analysis of asymptotic mean-square stability properties for systems of linear stochastic delay differential equations. Discrete & Continuous Dynamical Systems - B, 2013, 18 (6) : 1521-1531. doi: 10.3934/dcdsb.2013.18.1521 [14] Chengjun Guo, Chengxian Guo, Sameed Ahmed, Xinfeng Liu. Moment stability for nonlinear stochastic growth kinetics of breast cancer stem cells with time-delays. Discrete & Continuous Dynamical Systems - B, 2016, 21 (8) : 2473-2489. doi: 10.3934/dcdsb.2016056 [15] Michael Scheutzow. Exponential growth rate for a singular linear stochastic delay differential equation. Discrete & Continuous Dynamical Systems - B, 2013, 18 (6) : 1683-1696. doi: 10.3934/dcdsb.2013.18.1683 [16] Zhen Wang, Xiong Li, Jinzhi Lei. Second moment boundedness of linear stochastic delay differential equations. Discrete & Continuous Dynamical Systems - B, 2014, 19 (9) : 2963-2991. doi: 10.3934/dcdsb.2014.19.2963 [17] Boris P. Belinskiy, Peter Caithamer. Stochastic stability of some mechanical systems with a multiplicative white noise. Conference Publications, 2003, 2003 (Special) : 91-99. doi: 10.3934/proc.2003.2003.91 [18] Alexandra Rodkina, Henri Schurz, Leonid Shaikhet. Almost sure stability of some stochastic dynamical systems with memory. Discrete & Continuous Dynamical Systems - A, 2008, 21 (2) : 571-593. doi: 10.3934/dcds.2008.21.571 [19] Pierpaolo Soravia. Existence of absolute minimizers for noncoercive Hamiltonians and viscosity solutions of the Aronsson equation. Mathematical Control & Related Fields, 2012, 2 (4) : 399-427. doi: 10.3934/mcrf.2012.2.399 [20] X.H. Wu, Y. Efendiev, Thomas Y. Hou. Analysis of upscaling absolute permeability. Discrete & Continuous Dynamical Systems - B, 2002, 2 (2) : 185-204. doi: 10.3934/dcdsb.2002.2.185

2017 Impact Factor: 0.994