American Institute of Mathematical Sciences

Advanced
June  2011, 6(2): 329-349. doi: 10.3934/nhm.2011.6.329

Consensus and synchronization in discrete-time networks of multi-agents with stochastically switching topologies and time delays

Wenlian Lu 1, , Fatihcan M. Atay 2, and  Jürgen Jost 2,

1. 

Center for Computational Systems Biology, Laboratory of Mathematics for Nonlinear Sciences, School of Mathematical Sciences, Fudan University, Shanghai, 200433
2. 

Max Planck Institute for Mathematics in theSciences, Inselstr. 22, 04103 Leipzig, Germany

Received  August 2010 Revised  February 2011 Published  May 2011

We analyze stability of consensus algorithms in networks of multi-agents with time-varying topologies and delays. The topology and delays are modeled as induced by an adapted process and are rather general, including i.i.d. topology processes, asynchronous consensus algorithms, and Markovian jumping switching. In case the self-links are instantaneous, we prove that the network reaches consensus for all bounded delays if the graph corresponding to the conditional expectation of the coupling matrix sum across a finite time interval has a spanning tree almost surely. Moreover, when self-links are also delayed and when the delays satisfy certain integer patterns, we observe and prove that the algorithm may not reach consensus but instead synchronize at a periodic trajectory, whose period depends on the delay pattern. We also give a brief discussion on the dynamics in the absence of self-links.
Keywords: Consensus, network of multi-agents, synchronization, adapted process, switching topology., delay.
Mathematics Subject Classification: Primary: 93C05, 37H10, 15A51, 40A20; Secondary: 05C50, 60J1.
Citation: Wenlian Lu, Fatihcan M. Atay, Jürgen Jost. Consensus and synchronization in discrete-time networks of multi-agents with stochastically switching topologies and time delays. Networks & Heterogeneous Media, 2011, 6 (2) : 329-349. doi: 10.3934/nhm.2011.6.329
References:
[1]

P.-A. Bliman and G. Ferrari-Trecate, Average consensus problems in networks of agents with delayed communications, Automatica, 44 (2008), 1985-1995. doi: 10.1016/j.automatica.2007.12.010.  Google Scholar

[2]

M. Cao, A. S. Morse and B. D. O. Anderson, Reaching a consensus in a dynamically changing environment: A graphical approach, SIAM J. Control Optim., 47 (2008), 575-600. doi: 10.1137/060657005.  Google Scholar

[3]

S. Chatterjee and E. Seneta, Towards consensus: Some convergence theorems on repeated averaging, J. Appl. Prob., 14 (1977), 89-97. doi: 10.2307/3213262.  Google Scholar

[4]

O. Chilina, "f-Uniform Ergodicity of Markov Chains,'' Supervised Project, Unversity of Toronto, 2006. Google Scholar

[5]

M. H. DeGroot, Reaching a consensus, J. Amer. Statist. Assoc., 69 (1974), 118-121. doi: 10.2307/2285509.  Google Scholar

[6]

D. V. Dimarogonasa and K. H. Johansson, Stability analysis for multi-agent systems using the incidence matrix: Quantized communication and formation control, Automatica, 46 (2010), 695-700. doi: 10.1016/j.automatica.2010.01.012.  Google Scholar

[7]

R. Durrett, "Probability: Theory and Examples," 3rd edition, Belmont, CA: Duxbury Press, 2005.  Google Scholar

[8]

F. Fagnani and S. Zampieri, Average consensus with packet drop communication, SIAM J. Control Optim., 48 (2009), 102-133. doi: 10.1137/060676866.  Google Scholar

[9]

L. Fang, P. J. Antsaklis and A. Tzimas, Asynchronous consensus protocols: Preliminary results, simulations and open questions, Proceedings of the 44th IEEE Conf. Decision and Control, the Europ. Control Conference (2005), 2194-2199. Google Scholar

[10]

J. A. Fax and R. M. Murray, Information flow and cooperative control of vehicle formations, IEEE Trans. Autom. Control, 49 (2004), 1465-1476. doi: 10.1109/TAC.2004.834433.  Google Scholar

[11]

C. Godsil and G. Royle, "Algebraic Graph Theory," Springer-Verlag, New York, 2001.  Google Scholar

[12]

J. Hajnal, The ergodic properties of non-homogeneous finite Markov chains, Proc. Camb. Phil. Soc., 52 (1956), 67-77. doi: 10.1017/S0305004100030991.  Google Scholar

[13]

J. Hajnal, Weak ergodicity in non-homogeneous Markov chains, Proc. Camb. Phil. Soc., 54 (1958), 233-246. doi: 10.1017/S0305004100033399.  Google Scholar

[14]

Y. Hatano and M. Mesbahi, Agreement over random networks, IEEE Trans. Autom. Control, 50 (2005), 1867-1872. doi: 10.1109/TAC.2005.858670.  Google Scholar

[15]

R. A. Horn and C. R. Johnson, "Matrix Analysis," Cambridge University Press, 1985.  Google Scholar

[16]

Y. Kuramoto, "Chemical Oscillations, Waves, And Turbulence," Springer-Verlag, New York, 1984.  Google Scholar

[17]

J. Lin, A. S. Morse and B. D. O. Anderson, The multi-agent rendezvous problem Part 2: The asynchronous case, SIAM J. Control Optim., 46 (2007), 2120-2147. doi: 10.1137/040620564.  Google Scholar

[18]

B. Liu, W. Lu and T. Chen, Consensus in networks of multiagents with switching topologies modeled as adapted stochastic processes, SIAM J. Control Optim., 49 (2011), 227-253. doi: 10.1137/090745945.  Google Scholar

[19]

W. Lu, F. M. Atay and J. Jost, Synchronization of discrete-time networks with time-varying couplings, SIAM J. Math. Analys., 39 (2007), 1231-1259. doi: 10.1137/060657935.  Google Scholar

[20]

W. Lu, F. M. Atay and J. Jost, Chaos synchronization in networks of coupled maps with time-varying topologies, Eur. Phys. J. B, 63 (2008), 399-406. doi: 10.1140/epjb/e2008-00023-3.  Google Scholar

[21]

N. A. Lynch, "Distributed Algorithms," CA: Morgan Kaufmann, San Francisco, 1996.  Google Scholar

[22]

W. Ni and D. Z. Cheng, Leader-following consensus of multi-agent systems under fixed and switching topologies, Systems & Control Letters, 59 (2010), 209-217. doi: 10.1016/j.sysconle.2010.01.006.  Google Scholar

[23]

W. Michiels, C.-I. Morărescu and S.-I. Niculescu, Consensus problems with distributed delays, with application to traffic flow models, SIAM J. Control Optim., 48 (2009), 77-101. doi: 10.1137/060671425.  Google Scholar

[24]

L. Moreau, Stability of continuous-time distributed consensus algorithms, 43rd IEEE Conference on Decision and Control, 4 (2004), 3998-4003. Google Scholar

[25]

L. Moreau, Stability of multiagent systems with time-dependent communication links, IEEE Trans. Autom. Control, 50 (2005), 169-182. doi: 10.1109/TAC.2004.841888.  Google Scholar

[26]

R. Olfati-Saber and J. S. Shamma, Consensus filters for sensor networks and distributed sensor fusion, 44th IEEE Conference on Decision and Control 2005, and 2005 European Control Conference CDC-ECC '05. 6698-6703. doi: 10.1109/CDC.2005.1583238.  Google Scholar

[27]

R. Olfati-Saber, J. A. Fax and R. M. Murray, Consensus and cooperation in networked multi-agent systems, Proceedings of the IEEE, 95 (2007), 215-233. doi: 10.1109/JPROC.2006.887293.  Google Scholar

[28]

R. Olfati-Saber and R. M. Murray, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Autom. Control, 49 (2004), 1520-1533. doi: 10.1109/TAC.2004.834113.  Google Scholar

[29]

A. Pikovsky, M. Rosenblum and J. Kurths, "Synchronization: A Universal Concept in Nonlinear Sciences," Cambridge University Press, 2001. doi: 10.1017/CBO9780511755743.  Google Scholar

[30]

J. Shen, A geometric approach to ergodic non-homogeneous Markov chains, Wavelet Anal. Multi. Meth., LNPAM, 212 (2000), 341-366.  Google Scholar

[31]

A. Tahbaz-Salehi and A. Jadbabaie, A necessary and sufficient condition for consensus over random networks, IEEE Trans. Autom. Control, 53 (2008), 791-795. doi: 10.1109/TAC.2008.917743.  Google Scholar

[32]

T. Vicsek, A. Czirók, E. Ben-Jacob, I. Cohen and O. Shochet, Novel type of phase transition in a system of self-driven particles, Phys. Rev. Lett., 75 (1995), 1226-1229. doi: 10.1103/PhysRevLett.75.1226.  Google Scholar

[33]

A. T. Winfree, "The Geometry of Biological Time," Springer Verlag, New York, 1980.  Google Scholar

[34]

J. Wolfowitz, Products of indecomposable, aperiodic, stochastic matrices, Proceedings of AMS, 14 (1963), 733-737.  Google Scholar

[35]

C. W. Wu, Synchronization and convergence of linear dynamics in random directed networks, IEEE Trans. Autom. Control, 51 (2006), 1207-1210.  Google Scholar

[36]

F. Xiao and L. Wang, Consensus protocols for discrete-time multi-agent systems with time-varying delays, Automatica, 44 (2008), 2577-2582.  Google Scholar

[37]

F. Xiao and L. Wang, Asynchronous consensus in continuous-time multi-agent systems with switching topology and time-varying delays, IEEE Transactions on Automatic Control, 53 (2008), 1804-1816.  Google Scholar

[38]

Y. Zhang and Y.-P. Tian, Consentability and protocol design of multi-agent systems with stochastic switching topology, Automatica, 45 (2009), 1195-1201.  Google Scholar

show all references

References:
[1]

P.-A. Bliman and G. Ferrari-Trecate, Average consensus problems in networks of agents with delayed communications, Automatica, 44 (2008), 1985-1995. doi: 10.1016/j.automatica.2007.12.010.  Google Scholar

[2]

M. Cao, A. S. Morse and B. D. O. Anderson, Reaching a consensus in a dynamically changing environment: A graphical approach, SIAM J. Control Optim., 47 (2008), 575-600. doi: 10.1137/060657005.  Google Scholar

[3]

S. Chatterjee and E. Seneta, Towards consensus: Some convergence theorems on repeated averaging, J. Appl. Prob., 14 (1977), 89-97. doi: 10.2307/3213262.  Google Scholar

[4]

O. Chilina, "f-Uniform Ergodicity of Markov Chains,'' Supervised Project, Unversity of Toronto, 2006. Google Scholar

[5]

M. H. DeGroot, Reaching a consensus, J. Amer. Statist. Assoc., 69 (1974), 118-121. doi: 10.2307/2285509.  Google Scholar

[6]

D. V. Dimarogonasa and K. H. Johansson, Stability analysis for multi-agent systems using the incidence matrix: Quantized communication and formation control, Automatica, 46 (2010), 695-700. doi: 10.1016/j.automatica.2010.01.012.  Google Scholar

[7]

R. Durrett, "Probability: Theory and Examples," 3rd edition, Belmont, CA: Duxbury Press, 2005.  Google Scholar

[8]

F. Fagnani and S. Zampieri, Average consensus with packet drop communication, SIAM J. Control Optim., 48 (2009), 102-133. doi: 10.1137/060676866.  Google Scholar

[9]

L. Fang, P. J. Antsaklis and A. Tzimas, Asynchronous consensus protocols: Preliminary results, simulations and open questions, Proceedings of the 44th IEEE Conf. Decision and Control, the Europ. Control Conference (2005), 2194-2199. Google Scholar

[10]

J. A. Fax and R. M. Murray, Information flow and cooperative control of vehicle formations, IEEE Trans. Autom. Control, 49 (2004), 1465-1476. doi: 10.1109/TAC.2004.834433.  Google Scholar

[11]

C. Godsil and G. Royle, "Algebraic Graph Theory," Springer-Verlag, New York, 2001.  Google Scholar

[12]

J. Hajnal, The ergodic properties of non-homogeneous finite Markov chains, Proc. Camb. Phil. Soc., 52 (1956), 67-77. doi: 10.1017/S0305004100030991.  Google Scholar

[13]

J. Hajnal, Weak ergodicity in non-homogeneous Markov chains, Proc. Camb. Phil. Soc., 54 (1958), 233-246. doi: 10.1017/S0305004100033399.  Google Scholar

[14]

Y. Hatano and M. Mesbahi, Agreement over random networks, IEEE Trans. Autom. Control, 50 (2005), 1867-1872. doi: 10.1109/TAC.2005.858670.  Google Scholar

[15]

R. A. Horn and C. R. Johnson, "Matrix Analysis," Cambridge University Press, 1985.  Google Scholar

[16]

Y. Kuramoto, "Chemical Oscillations, Waves, And Turbulence," Springer-Verlag, New York, 1984.  Google Scholar

[17]

J. Lin, A. S. Morse and B. D. O. Anderson, The multi-agent rendezvous problem Part 2: The asynchronous case, SIAM J. Control Optim., 46 (2007), 2120-2147. doi: 10.1137/040620564.  Google Scholar

[18]

B. Liu, W. Lu and T. Chen, Consensus in networks of multiagents with switching topologies modeled as adapted stochastic processes, SIAM J. Control Optim., 49 (2011), 227-253. doi: 10.1137/090745945.  Google Scholar

[19]

W. Lu, F. M. Atay and J. Jost, Synchronization of discrete-time networks with time-varying couplings, SIAM J. Math. Analys., 39 (2007), 1231-1259. doi: 10.1137/060657935.  Google Scholar

[20]

W. Lu, F. M. Atay and J. Jost, Chaos synchronization in networks of coupled maps with time-varying topologies, Eur. Phys. J. B, 63 (2008), 399-406. doi: 10.1140/epjb/e2008-00023-3.  Google Scholar

[21]

N. A. Lynch, "Distributed Algorithms," CA: Morgan Kaufmann, San Francisco, 1996.  Google Scholar

[22]

W. Ni and D. Z. Cheng, Leader-following consensus of multi-agent systems under fixed and switching topologies, Systems & Control Letters, 59 (2010), 209-217. doi: 10.1016/j.sysconle.2010.01.006.  Google Scholar

[23]

W. Michiels, C.-I. Morărescu and S.-I. Niculescu, Consensus problems with distributed delays, with application to traffic flow models, SIAM J. Control Optim., 48 (2009), 77-101. doi: 10.1137/060671425.  Google Scholar

[24]

L. Moreau, Stability of continuous-time distributed consensus algorithms, 43rd IEEE Conference on Decision and Control, 4 (2004), 3998-4003. Google Scholar

[25]

L. Moreau, Stability of multiagent systems with time-dependent communication links, IEEE Trans. Autom. Control, 50 (2005), 169-182. doi: 10.1109/TAC.2004.841888.  Google Scholar

[26]

R. Olfati-Saber and J. S. Shamma, Consensus filters for sensor networks and distributed sensor fusion, 44th IEEE Conference on Decision and Control 2005, and 2005 European Control Conference CDC-ECC '05. 6698-6703. doi: 10.1109/CDC.2005.1583238.  Google Scholar

[27]

R. Olfati-Saber, J. A. Fax and R. M. Murray, Consensus and cooperation in networked multi-agent systems, Proceedings of the IEEE, 95 (2007), 215-233. doi: 10.1109/JPROC.2006.887293.  Google Scholar

[28]

R. Olfati-Saber and R. M. Murray, Consensus problems in networks of agents with switching topology and time-delays, IEEE Trans. Autom. Control, 49 (2004), 1520-1533. doi: 10.1109/TAC.2004.834113.  Google Scholar

[29]

A. Pikovsky, M. Rosenblum and J. Kurths, "Synchronization: A Universal Concept in Nonlinear Sciences," Cambridge University Press, 2001. doi: 10.1017/CBO9780511755743.  Google Scholar

[30]

J. Shen, A geometric approach to ergodic non-homogeneous Markov chains, Wavelet Anal. Multi. Meth., LNPAM, 212 (2000), 341-366.  Google Scholar

[31]

A. Tahbaz-Salehi and A. Jadbabaie, A necessary and sufficient condition for consensus over random networks, IEEE Trans. Autom. Control, 53 (2008), 791-795. doi: 10.1109/TAC.2008.917743.  Google Scholar

[32]

T. Vicsek, A. Czirók, E. Ben-Jacob, I. Cohen and O. Shochet, Novel type of phase transition in a system of self-driven particles, Phys. Rev. Lett., 75 (1995), 1226-1229. doi: 10.1103/PhysRevLett.75.1226.  Google Scholar

[33]

A. T. Winfree, "The Geometry of Biological Time," Springer Verlag, New York, 1980.  Google Scholar

[34]

J. Wolfowitz, Products of indecomposable, aperiodic, stochastic matrices, Proceedings of AMS, 14 (1963), 733-737.  Google Scholar

[35]

C. W. Wu, Synchronization and convergence of linear dynamics in random directed networks, IEEE Trans. Autom. Control, 51 (2006), 1207-1210.  Google Scholar

[36]

F. Xiao and L. Wang, Consensus protocols for discrete-time multi-agent systems with time-varying delays, Automatica, 44 (2008), 2577-2582.  Google Scholar

[37]

F. Xiao and L. Wang, Asynchronous consensus in continuous-time multi-agent systems with switching topology and time-varying delays, IEEE Transactions on Automatic Control, 53 (2008), 1804-1816.  Google Scholar

[38]

Y. Zhang and Y.-P. Tian, Consentability and protocol design of multi-agent systems with stochastic switching topology, Automatica, 45 (2009), 1195-1201.  Google Scholar

[1]

Xiaojin Huang, Hongfu Yang, Jianhua Huang. Consensus stability analysis for stochastic multi-agent systems with multiplicative measurement noises and Markovian switching topologies. Numerical Algebra, Control & Optimization, 2021  doi: 10.3934/naco.2021024
[2]

Stefano Cosenza, Paolo Crucitti, Luigi Fortuna, Mattia Frasca, Manuela La Rosa, Cecilia Stagni, Lisa Usai. From Net Topology to Synchronization in HR Neuron Grids. Mathematical Biosciences & Engineering, 2005, 2 (1) : 53-77. doi: 10.3934/mbe.2005.2.53
[3]

Ankang Yu, Yajuan Yang, Baode Li. A new Carleson measure adapted to multi-level ellipsoid covers. Communications on Pure & Applied Analysis, 2021, 20 (10) : 3465-3481. doi: 10.3934/cpaa.2021115
[4]

Marina Dolfin, Mirosław Lachowicz. Modeling opinion dynamics: How the network enhances consensus. Networks & Heterogeneous Media, 2015, 10 (4) : 877-896. doi: 10.3934/nhm.2015.10.877
[5]

Yejuan Wang, Peter E. Kloeden. The uniform attractor of a multi-valued process generated by reaction-diffusion delay equations on an unbounded domain. Discrete & Continuous Dynamical Systems, 2014, 34 (10) : 4343-4370. doi: 10.3934/dcds.2014.34.4343
[6]

Shuping Li, Zhen Jin. Impacts of cluster on network topology structure and epidemic spreading. Discrete & Continuous Dynamical Systems - B, 2017, 22 (10) : 3749-3770. doi: 10.3934/dcdsb.2017187
[7]

Jin-Liang Wang, Zhi-Chun Yang, Tingwen Huang, Mingqing Xiao. Local and global exponential synchronization of complex delayed dynamical networks with general topology. Discrete & Continuous Dynamical Systems - B, 2011, 16 (1) : 393-408. doi: 10.3934/dcdsb.2011.16.393
[8]

Joseph D. Skufca, Erik M. Bollt. Communication and Synchronization in Disconnected Networks with Dynamic Topology: Moving Neighborhood Networks. Mathematical Biosciences & Engineering, 2004, 1 (2) : 347-359. doi: 10.3934/mbe.2004.1.347
[9]

Yilun Shang. Group pinning consensus under fixed and randomly switching topologies with acyclic partition. Networks & Heterogeneous Media, 2014, 9 (3) : 553-573. doi: 10.3934/nhm.2014.9.553
[10]

Stefano Fasani, Sergio Rinaldi. Local stabilization and network synchronization: The case of stationary regimes. Mathematical Biosciences & Engineering, 2010, 7 (3) : 623-639. doi: 10.3934/mbe.2010.7.623
[11]

Yicheng Liu, Yipeng Chen, Jun Wu, Xiao Wang. Periodic consensus in network systems with general distributed processing delays. Networks & Heterogeneous Media, 2021, 16 (1) : 139-153. doi: 10.3934/nhm.2021002
[12]

Deena Schmidt, Janet Best, Mark S. Blumberg. Random graph and stochastic process contributions to network dynamics. Conference Publications, 2011, 2011 (Special) : 1279-1288. doi: 10.3934/proc.2011.2011.1279
[13]

Giulia Cavagnari, Antonio Marigonda, Benedetto Piccoli. Optimal synchronization problem for a multi-agent system. Networks & Heterogeneous Media, 2017, 12 (2) : 277-295. doi: 10.3934/nhm.2017012
[14]

Hiroaki Uchida, Yuya Oishi, Toshimichi Saito. A simple digital spiking neural network: Synchronization and spike-train approximation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (4) : 1479-1494. doi: 10.3934/dcdss.2020374
[15]

Francesco Sanna Passino, Nicholas A. Heard. Modelling dynamic network evolution as a Pitman-Yor process. Foundations of Data Science, 2019, 1 (3) : 293-306. doi: 10.3934/fods.2019013
[16]

Rui Li, Yingjing Shi. Finite-time optimal consensus control for second-order multi-agent systems. Journal of Industrial & Management Optimization, 2014, 10 (3) : 929-943. doi: 10.3934/jimo.2014.10.929
[17]

Xi Zhu, Meixia Li, Chunfa Li. Consensus in discrete-time multi-agent systems with uncertain topologies and random delays governed by a Markov chain. Discrete & Continuous Dynamical Systems - B, 2020, 25 (12) : 4535-4551. doi: 10.3934/dcdsb.2020111
[18]

Zhongkui Li, Zhisheng Duan, Guanrong Chen. Consensus of discrete-time linear multi-agent systems with observer-type protocols. Discrete & Continuous Dynamical Systems - B, 2011, 16 (2) : 489-505. doi: 10.3934/dcdsb.2011.16.489
[19]

Yibo Zhang, Jinfeng Gao, Jia Ren, Huijiao Wang. A type of new consensus protocol for two-dimension multi-agent systems. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 345-357. doi: 10.3934/naco.2017022
[20]

Ke Yang, Wencheng Zou, Zhengrong Xiang, Ronghao Wang. Fully distributed consensus for higher-order nonlinear multi-agent systems with unmatched disturbances. Discrete & Continuous Dynamical Systems - S, 2021, 14 (4) : 1535-1551. doi: 10.3934/dcdss.2020396

2020 Impact Factor: 1.213

Tools

Metrics

  • PDF downloads (97)
  • HTML views (0)
  • Cited by (20)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences