American Institute of Mathematical Sciences

Advanced
November  2011, 16(4): 1197-1211. doi: 10.3934/dcdsb.2011.16.1197

Stabilization of discrete-time Markovian jump systems with partially unknown transition probabilities

Qingling Zhang 1, , Guoliang Wang 2, , Wanquan Liu 3, and  Yi Zhang 1,

1. 

Institute of Systems Science, Northeastern University, Shenyang, Liaoning, 110819, China, China
2. 

School of Information and Control Engineering, Liaoning Shihua University, Fushun, Liaoning 113001, China
3. 

Department of Computing, Curtin University of Technology, Perth, WA 6102, Australia

Received  August 2010 Revised  March 2011 Published  August 2011

In this paper the stabilization problem for a class of discrete-time Markovian jump system with partially unknown transition probabilities is investigated via using the time-delayed and impulsive controllers. As some elements in transition matrix are unknown, a new approach is proposed to estimate the unknown elements, in which an impulsive stabilizing controller depending on time delays and system mode is presented in terms of linear matrix inequalities (LMIs) with equality constraints. Especially, if there are no time delays and impulsive effects in the controller, it is derived that the conditions for the existence of $H_\infty$ controller can be expressed by LMIs without equality constraints. Finally, illustrative examples are presented to show the benefits and the validity of the proposed approaches.
Keywords: Impulsive controllers., Time delay systems, Markovian jump systems, Partially unknown transition probabilities.
Mathematics Subject Classification: Primary: 34K20; Secondary: 37A6.
Citation: Qingling Zhang, Guoliang Wang, Wanquan Liu, Yi Zhang. Stabilization of discrete-time Markovian jump systems with partially unknown transition probabilities. Discrete & Continuous Dynamical Systems - B, 2011, 16 (4) : 1197-1211. doi: 10.3934/dcdsb.2011.16.1197
References:
[1]

E. Boukas and Z. Liu, Robust $H_\infty$ control of discrete-time Markovian jump linear systems with mode-dependent time-delays,, IEEE Transactions on Automatic Control, 46 (2001), 1918.   Google Scholar

[2]

W. Chen, Z. Guan and P. Yu, Delay-dependent stability and $H_\infty$ control of uncertain discrete-time Markovian jump systems with mode-dependent time delays,, Systems and Control Letters, 52 (2004), 361.   Google Scholar

[3]

O. Costa, Stability results for discrete-time linear systems with Markovian jumping parameters,, Journal of Mathematical Analysis and Applications, 179 (1993), 154.  doi: 10.1006/jmaa.1993.1341.  Google Scholar

[4]

C. de Souza, Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems,, IEEE Transactions on Automatic Control, 51 (2006), 836.  doi: 10.1109/TAC.2006.875012.  Google Scholar

[5]

Y. Dong and J. Sun, On hybrid control of a class of stochastic non-linear Markovian switching systems,, Automatica, 44 (2008), 990.  doi: 10.1016/j.automatica.2007.08.006.  Google Scholar

[6]

L. Ghaoui, F. Oustry and M. AitRami, A cone complementarity linearization algorithm for static output-feedback and related problems,, IEEE Transactions on Automatic Control, 42 (1997), 1171.  doi: 10.1109/9.618250.  Google Scholar

[7]

Z. Guan, D. Hill and X. Shen, On hybrid impulsive and switching systems and application to nonlinear control,, IEEE Transactions on Automatic Control, 50 (2005), 1058.  doi: 10.1109/TAC.2005.851462.  Google Scholar

[8]

P. V. Laxmi and O. M. Yesuf, Analysis of a finite buffer general input queue with Markovian service process and accessible and non-accessible batch service,, Journal of Industrial and Management Optimization, 6 (2010), 929.  doi: 10.3934/jimo.2010.6.929.  Google Scholar

[9]

F. Leibfritz, An LMI-based algorithm for designing suboptimal static $H_2$/$H_\infty$ output feedback controllers,, SIAM Journal on Control and Optimization, 39 (2001), 1171.   Google Scholar

[10]

S. Pan, J. Sun and S. Zhao, Stabilization of discrete-time Markovian jump linear systems via time-delayed and impulsive controllers,, Automatica, 44 (2008), 2954.  doi: 10.1016/j.automatica.2008.04.004.  Google Scholar

[11]

P. Seiler and R. Sengupta, A bounded real lemma for jump systems,, IEEE Transactions on Automatic Control, 48 (2003), 1651.  doi: 10.1109/TAC.2003.817010.  Google Scholar

[12]

P. Shi, E. Boukas and R. Agarwal, Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay,, IEEE Transactions on Automatic Control, 44 (1999), 2139.  doi: 10.1109/9.802932.  Google Scholar

[13]

P. Shi, E. Boukas and R. Agarwal, Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,, IEEE Transactions on Automatic Control, 44 (1999), 1592.  doi: 10.1109/9.780431.  Google Scholar

[14]

Y. Shi, P. Shi and M. S. Mahmoud, $H_\infty$ and robust control of interconnected systems with Markovian jump parameters,, Discrete and Continuous Dynamical Systems-Series B, 5 (2005), 365.   Google Scholar

[15]

M. Telek and Z. Saffer, Analysis of globally gated Markovian limited cyclic polling model and its application to uplink traffic in the IEEE 802.16 network,, Journal of Industrial and Management Optimization, 7 (2011), 677.  doi: 10.3934/jimo.2011.7.677.  Google Scholar

[16]

G. Wang, Q. Zhang and V. Sreeram, Robust delay-range-dependent stabilization for Markovian jump systems with mode-dependent time delays and nonlinearities,, Optimal Control Applications and Methods, 31 (2010), 249.   Google Scholar

[17]

G. Wang, Q. Zhang and V. Sreeram, $H_\infty$ control for discrete-time singularly perturbed systems with two Markov processes,, Journal of The Franklin Institute, 347 (2010), 836.  doi: 10.1016/j.jfranklin.2010.03.007.  Google Scholar

[18]

H. Wu and J. Sun, $p$-Moment stability of stochastic differential equations with impulsvie jump and Markovian switching,, Automatica, 42 (2006), 1753.  doi: 10.1016/j.automatica.2006.05.009.  Google Scholar

[19]

J. Xiong, J. Lam, H. Gao and D. Ho, On robust stabilization of Markovian jump systems with uncertain switching probabilities,, Automatica, 41 (2005), 897.  doi: 10.1016/j.automatica.2004.12.001.  Google Scholar

[20]

J. Xiong and J. Lam, Stabilization of discrete-time Markovian jump linear systems via time-delyed controllers,, Automatica, 42 (2006), 747.  doi: 10.1016/j.automatica.2005.12.015.  Google Scholar

[21]

S. Xu, T. Chen and J. Lam, Robust $H_\infty$ filtering for uncertain Markovian jump systems with mode-dependent time delays,, IEEE Transactions on Automatic Control, 48 (2003), 900.  doi: 10.1109/TAC.2003.811277.  Google Scholar

[22]

S. Xu and J. Lam, Delay-dependent $H_\infty$ control and filtering for uncertain Markovian jump systems with time-varying delays,, IEEE Transactions on Circuits and Systems, 54 (2007), 2070.  doi: 10.1109/TCSI.2007.904640.  Google Scholar

[23]

Z. Yang and D. Xu, Stability analysis and design of impulsive control systems with time delay,, IEEE Transactions on Automatic Control, 52 (2007), 1448.  doi: 10.1109/TAC.2007.902748.  Google Scholar

[24]

L. Zhang and E. Boukas, Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities,, Automatica, 45 (2009), 463.  doi: 10.1016/j.automatica.2008.08.010.  Google Scholar

[25]

L. Zhang and E. Boukas, $H_\infty$ control for discrete-time Markovian jump linear systems with partly unknown transition probabilities,, International Journal of Robust and Nonlinear Control, 19 (2009), 868.  doi: 10.1002/rnc.1355.  Google Scholar

show all references

References:
[1]

E. Boukas and Z. Liu, Robust $H_\infty$ control of discrete-time Markovian jump linear systems with mode-dependent time-delays,, IEEE Transactions on Automatic Control, 46 (2001), 1918.   Google Scholar

[2]

W. Chen, Z. Guan and P. Yu, Delay-dependent stability and $H_\infty$ control of uncertain discrete-time Markovian jump systems with mode-dependent time delays,, Systems and Control Letters, 52 (2004), 361.   Google Scholar

[3]

O. Costa, Stability results for discrete-time linear systems with Markovian jumping parameters,, Journal of Mathematical Analysis and Applications, 179 (1993), 154.  doi: 10.1006/jmaa.1993.1341.  Google Scholar

[4]

C. de Souza, Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems,, IEEE Transactions on Automatic Control, 51 (2006), 836.  doi: 10.1109/TAC.2006.875012.  Google Scholar

[5]

Y. Dong and J. Sun, On hybrid control of a class of stochastic non-linear Markovian switching systems,, Automatica, 44 (2008), 990.  doi: 10.1016/j.automatica.2007.08.006.  Google Scholar

[6]

L. Ghaoui, F. Oustry and M. AitRami, A cone complementarity linearization algorithm for static output-feedback and related problems,, IEEE Transactions on Automatic Control, 42 (1997), 1171.  doi: 10.1109/9.618250.  Google Scholar

[7]

Z. Guan, D. Hill and X. Shen, On hybrid impulsive and switching systems and application to nonlinear control,, IEEE Transactions on Automatic Control, 50 (2005), 1058.  doi: 10.1109/TAC.2005.851462.  Google Scholar

[8]

P. V. Laxmi and O. M. Yesuf, Analysis of a finite buffer general input queue with Markovian service process and accessible and non-accessible batch service,, Journal of Industrial and Management Optimization, 6 (2010), 929.  doi: 10.3934/jimo.2010.6.929.  Google Scholar

[9]

F. Leibfritz, An LMI-based algorithm for designing suboptimal static $H_2$/$H_\infty$ output feedback controllers,, SIAM Journal on Control and Optimization, 39 (2001), 1171.   Google Scholar

[10]

S. Pan, J. Sun and S. Zhao, Stabilization of discrete-time Markovian jump linear systems via time-delayed and impulsive controllers,, Automatica, 44 (2008), 2954.  doi: 10.1016/j.automatica.2008.04.004.  Google Scholar

[11]

P. Seiler and R. Sengupta, A bounded real lemma for jump systems,, IEEE Transactions on Automatic Control, 48 (2003), 1651.  doi: 10.1109/TAC.2003.817010.  Google Scholar

[12]

P. Shi, E. Boukas and R. Agarwal, Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay,, IEEE Transactions on Automatic Control, 44 (1999), 2139.  doi: 10.1109/9.802932.  Google Scholar

[13]

P. Shi, E. Boukas and R. Agarwal, Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,, IEEE Transactions on Automatic Control, 44 (1999), 1592.  doi: 10.1109/9.780431.  Google Scholar

[14]

Y. Shi, P. Shi and M. S. Mahmoud, $H_\infty$ and robust control of interconnected systems with Markovian jump parameters,, Discrete and Continuous Dynamical Systems-Series B, 5 (2005), 365.   Google Scholar

[15]

M. Telek and Z. Saffer, Analysis of globally gated Markovian limited cyclic polling model and its application to uplink traffic in the IEEE 802.16 network,, Journal of Industrial and Management Optimization, 7 (2011), 677.  doi: 10.3934/jimo.2011.7.677.  Google Scholar

[16]

G. Wang, Q. Zhang and V. Sreeram, Robust delay-range-dependent stabilization for Markovian jump systems with mode-dependent time delays and nonlinearities,, Optimal Control Applications and Methods, 31 (2010), 249.   Google Scholar

[17]

G. Wang, Q. Zhang and V. Sreeram, $H_\infty$ control for discrete-time singularly perturbed systems with two Markov processes,, Journal of The Franklin Institute, 347 (2010), 836.  doi: 10.1016/j.jfranklin.2010.03.007.  Google Scholar

[18]

H. Wu and J. Sun, $p$-Moment stability of stochastic differential equations with impulsvie jump and Markovian switching,, Automatica, 42 (2006), 1753.  doi: 10.1016/j.automatica.2006.05.009.  Google Scholar

[19]

J. Xiong, J. Lam, H. Gao and D. Ho, On robust stabilization of Markovian jump systems with uncertain switching probabilities,, Automatica, 41 (2005), 897.  doi: 10.1016/j.automatica.2004.12.001.  Google Scholar

[20]

J. Xiong and J. Lam, Stabilization of discrete-time Markovian jump linear systems via time-delyed controllers,, Automatica, 42 (2006), 747.  doi: 10.1016/j.automatica.2005.12.015.  Google Scholar

[21]

S. Xu, T. Chen and J. Lam, Robust $H_\infty$ filtering for uncertain Markovian jump systems with mode-dependent time delays,, IEEE Transactions on Automatic Control, 48 (2003), 900.  doi: 10.1109/TAC.2003.811277.  Google Scholar

[22]

S. Xu and J. Lam, Delay-dependent $H_\infty$ control and filtering for uncertain Markovian jump systems with time-varying delays,, IEEE Transactions on Circuits and Systems, 54 (2007), 2070.  doi: 10.1109/TCSI.2007.904640.  Google Scholar

[23]

Z. Yang and D. Xu, Stability analysis and design of impulsive control systems with time delay,, IEEE Transactions on Automatic Control, 52 (2007), 1448.  doi: 10.1109/TAC.2007.902748.  Google Scholar

[24]

L. Zhang and E. Boukas, Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities,, Automatica, 45 (2009), 463.  doi: 10.1016/j.automatica.2008.08.010.  Google Scholar

[25]

L. Zhang and E. Boukas, $H_\infty$ control for discrete-time Markovian jump linear systems with partly unknown transition probabilities,, International Journal of Robust and Nonlinear Control, 19 (2009), 868.  doi: 10.1002/rnc.1355.  Google Scholar

[1]

Hui Lv, Xing'an Wang. Dissipative control for uncertain singular markovian jump systems via hybrid impulsive control. Numerical Algebra, Control & Optimization, 2019, 0 (0) : 0-0. doi: 10.3934/naco.2020020
[2]

M. S. Mahmoud, P. Shi, Y. Shi. $H_\infty$ and robust control of interconnected systems with Markovian jump parameters. Discrete & Continuous Dynamical Systems - B, 2005, 5 (2) : 365-384. doi: 10.3934/dcdsb.2005.5.365
[3]

Jian Chen, Tao Zhang, Ziye Zhang, Chong Lin, Bing Chen. Stability and output feedback control for singular Markovian jump delayed systems. Mathematical Control & Related Fields, 2018, 8 (2) : 475-490. doi: 10.3934/mcrf.2018019
[4]

Guoshan Zhang, Shiwei Wang, Yiming Wang, Wanquan Liu. LS-SVM approximate solution for affine nonlinear systems with partially unknown functions. Journal of Industrial & Management Optimization, 2014, 10 (2) : 621-636. doi: 10.3934/jimo.2014.10.621
[5]

Xiaowei Tang, Xilin Fu. New comparison principle with Razumikhin condition for impulsive infinite delay differential systems. Conference Publications, 2009, 2009 (Special) : 739-743. doi: 10.3934/proc.2009.2009.739
[6]

Lizhao Yan, Fei Xu, Yongzeng Lai, Mingyong Lai. Stability strategies of manufacturing-inventory systems with unknown time-varying demand. Journal of Industrial & Management Optimization, 2017, 13 (4) : 2033-2047. doi: 10.3934/jimo.2017030
[7]

Baskar Sundaravadivoo. Controllability analysis of nonlinear fractional order differential systems with state delay and non-instantaneous impulsive effects. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 0-0. doi: 10.3934/dcdss.2020138
[8]

Jingang Zhao, Chi Zhang. Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning. Journal of Industrial & Management Optimization, 2017, 13 (5) : 0-0. doi: 10.3934/jimo.2020030
[9]

Linna Li, Changjun Yu, Ning Zhang, Yanqin Bai, Zhiyuan Gao. A time-scaling technique for time-delay switched systems. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 0-0. doi: 10.3934/dcdss.2020108
[10]

Y. Peng, X. Xiang. Second order nonlinear impulsive time-variant systems with unbounded perturbation and optimal controls. Journal of Industrial & Management Optimization, 2008, 4 (1) : 17-32. doi: 10.3934/jimo.2008.4.17
[11]

B. Cantó, C. Coll, A. Herrero, E. Sánchez, N. Thome. Pole-assignment of discrete time-delay systems with symmetries. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 641-649. doi: 10.3934/dcdsb.2006.6.641
[12]

Ming He, Xiaoyun Ma, Weijiang Zhang. Oscillation death in systems of oscillators with transferable coupling and time-delay. Discrete & Continuous Dynamical Systems - A, 2001, 7 (4) : 737-745. doi: 10.3934/dcds.2001.7.737
[13]

Qinqin Chai, Ryan Loxton, Kok Lay Teo, Chunhua Yang. A unified parameter identification method for nonlinear time-delay systems. Journal of Industrial & Management Optimization, 2013, 9 (2) : 471-486. doi: 10.3934/jimo.2013.9.471
[14]

Xiang Xie, Honglei Xu, Xinming Cheng, Yilun Yu. Improved results on exponential stability of discrete-time switched delay systems. Discrete & Continuous Dynamical Systems - B, 2017, 22 (1) : 199-208. doi: 10.3934/dcdsb.2017010
[15]

Akram Kheirabadi, Asadollah Mahmoudzadeh Vaziri, Sohrab Effati. Linear optimal control of time delay systems via Hermite wavelet. Numerical Algebra, Control & Optimization, 2019, 0 (0) : 0-0. doi: 10.3934/naco.2019044
[16]

Chongyang Liu, Meijia Han, Zhaohua Gong, Kok Lay Teo. Robust parameter estimation for constrained time-delay systems with inexact measurements. Journal of Industrial & Management Optimization, 2017, 13 (5) : 0-0. doi: 10.3934/jimo.2019113
[17]

Jiaohui Xu, Tomás Caraballo. Long time behavior of fractional impulsive stochastic differential equations with infinite delay. Discrete & Continuous Dynamical Systems - B, 2019, 24 (6) : 2719-2743. doi: 10.3934/dcdsb.2018272
[18]

Pengfei Zhang. Partially hyperbolic sets with positive measure and $ACIP$ for partially hyperbolic systems. Discrete & Continuous Dynamical Systems - A, 2012, 32 (4) : 1435-1447. doi: 10.3934/dcds.2012.32.1435
[19]

Michael Basin, Pablo Rodriguez-Ramirez. An optimal impulsive control regulator for linear systems. Numerical Algebra, Control & Optimization, 2011, 1 (2) : 275-282. doi: 10.3934/naco.2011.1.275
[20]

George Ballinger, Xinzhi Liu. Boundedness criteria in terms of two measures for impulsive systems. Conference Publications, 1998, 1998 (Special) : 79-88. doi: 10.3934/proc.1998.1998.79

2018 Impact Factor: 1.008

Tools

Metrics

  • PDF downloads (23)
  • HTML views (0)
  • Cited by (2)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences