# American Institute of Mathematical Sciences

## Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain

 1 School of Management, Tianjin University of Technology, Tianjin 300384, China 2 Department of Basic Education, Tianjin City Vocational College, Tianjin 300250, China

* Corresponding author: Xi Zhu

Received  April 2019 Revised  October 2019 Published  March 2020

Fund Project: The first author is supported by the National Natural Science Foundation of China grant 61440058, 11501412 and 11401073

In this paper, we study consensus problem in a discrete-time multi-agent system with uncertain topologies and random delays governed by a Markov chain. The communication topology is assumed to be directed but interrupted by system uncertainties. Furthermore, the system delays are modeled by a Markov chain. We first use a reduced-order system featuring the error dynamics to transform the consensus problem of the original one into the stabilization of the error dynamic system. By using the linear matrix inequality method and the stability theory in stochastic systems with time-delay, several sufficient conditions are established for the mean square stability of the error dynamics which guarantees consensus. By redesigning its adjacency matrices, we develop a switching control scheme which is delay-dependent. Finally, simulation results are worked out to illustrate the theoretical results.

Citation: Xi Zhu, Meixia Li, Chunfa Li. Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain. Discrete & Continuous Dynamical Systems - B, doi: 10.3934/dcdsb.2020111
##### References:

show all references

##### References:
Communication topology with a directed spanning tree
Time delay ($d_k$) over time
State of all nodes in the original system
State of all nodes under the control scheme in [18] when $\alpha_0 = 0.26$
Consensus with switching adjacency matrices when $\alpha_0 = 0.26$
 [1] Giulia Cavagnari, Antonio Marigonda, Benedetto Piccoli. Optimal synchronization problem for a multi-agent system. Networks & Heterogeneous Media, 2017, 12 (2) : 277-295. doi: 10.3934/nhm.2017012 [2] Rui Li, Yingjing Shi. Finite-time optimal consensus control for second-order multi-agent systems. Journal of Industrial & Management Optimization, 2014, 10 (3) : 929-943. doi: 10.3934/jimo.2014.10.929 [3] Zhongkui Li, Zhisheng Duan, Guanrong Chen. Consensus of discrete-time linear multi-agent systems with observer-type protocols. Discrete & Continuous Dynamical Systems - B, 2011, 16 (2) : 489-505. doi: 10.3934/dcdsb.2011.16.489 [4] Yibo Zhang, Jinfeng Gao, Jia Ren, Huijiao Wang. A type of new consensus protocol for two-dimension multi-agent systems. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 345-357. doi: 10.3934/naco.2017022 [5] Seung-Yeal Ha, Dohyun Kim, Jaeseung Lee, Se Eun Noh. Emergent dynamics of an orientation flocking model for multi-agent system. Discrete & Continuous Dynamical Systems - A, 2020, 40 (4) : 2037-2060. doi: 10.3934/dcds.2020105 [6] Hong Man, Yibin Yu, Yuebang He, Hui Huang. Design of one type of linear network prediction controller for multi-agent system. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 727-734. doi: 10.3934/dcdss.2019047 [7] Brendan Pass. Multi-marginal optimal transport and multi-agent matching problems: Uniqueness and structure of solutions. Discrete & Continuous Dynamical Systems - A, 2014, 34 (4) : 1623-1639. doi: 10.3934/dcds.2014.34.1623 [8] Tyrone E. Duncan. Some partially observed multi-agent linear exponential quadratic stochastic differential games. Evolution Equations & Control Theory, 2018, 7 (4) : 587-597. doi: 10.3934/eect.2018028 [9] Zhiyong Sun, Toshiharu Sugie. Identification of Hessian matrix in distributed gradient-based multi-agent coordination control systems. Numerical Algebra, Control & Optimization, 2019, 9 (3) : 297-318. doi: 10.3934/naco.2019020 [10] Masoud Mohammadzadeh, Alireza Arshadi Khamseh, Mohammad Mohammadi. A multi-objective integrated model for closed-loop supply chain configuration and supplier selection considering uncertain demand and different performance levels. Journal of Industrial & Management Optimization, 2017, 13 (2) : 1041-1064. doi: 10.3934/jimo.2016061 [11] Samuel N. Cohen, Lukasz Szpruch. On Markovian solutions to Markov Chain BSDEs. Numerical Algebra, Control & Optimization, 2012, 2 (2) : 257-269. doi: 10.3934/naco.2012.2.257 [12] Eugenii Shustin. Dynamics of oscillations in a multi-dimensional delay differential system. Discrete & Continuous Dynamical Systems - A, 2004, 11 (2&3) : 557-576. doi: 10.3934/dcds.2004.11.557 [13] Mario Roy, Mariusz Urbański. Random graph directed Markov systems. Discrete & Continuous Dynamical Systems - A, 2011, 30 (1) : 261-298. doi: 10.3934/dcds.2011.30.261 [14] Jinhu Xu, Yicang Zhou. Global stability of a multi-group model with vaccination age, distributed delay and random perturbation. Mathematical Biosciences & Engineering, 2015, 12 (5) : 1083-1106. doi: 10.3934/mbe.2015.12.1083 [15] Johnathan M. Bardsley. Gaussian Markov random field priors for inverse problems. Inverse Problems & Imaging, 2013, 7 (2) : 397-416. doi: 10.3934/ipi.2013.7.397 [16] Manfred Denker, Yuri Kifer, Manuel Stadlbauer. Thermodynamic formalism for random countable Markov shifts. Discrete & Continuous Dynamical Systems - A, 2008, 22 (1&2) : 131-164. doi: 10.3934/dcds.2008.22.131 [17] Felix X.-F. Ye, Yue Wang, Hong Qian. Stochastic dynamics: Markov chains and random transformations. Discrete & Continuous Dynamical Systems - B, 2016, 21 (7) : 2337-2361. doi: 10.3934/dcdsb.2016050 [18] Manfred Denker, Yuri Kifer, Manuel Stadlbauer. Corrigendum to: Thermodynamic formalism for random countable Markov shifts. Discrete & Continuous Dynamical Systems - A, 2015, 35 (1) : 593-594. doi: 10.3934/dcds.2015.35.593 [19] Jingzhi Tie, Qing Zhang. An optimal mean-reversion trading rule under a Markov chain model. Mathematical Control & Related Fields, 2016, 6 (3) : 467-488. doi: 10.3934/mcrf.2016012 [20] Ralf Banisch, Carsten Hartmann. A sparse Markov chain approximation of LQ-type stochastic control problems. Mathematical Control & Related Fields, 2016, 6 (3) : 363-389. doi: 10.3934/mcrf.2016007

2018 Impact Factor: 1.008