October  2013, 33(10): 4693-4729. doi: 10.3934/dcds.2013.33.4693

Global asymptotic dynamics of a class of nonlinearly coupled neural networks with delays

1. 

Department of Applied Mathematics, National Pingtung University of Education, Pingtung 900, Taiwan

Received  September 2012 Revised  January 2013 Published  April 2013

This work presents an effective approach to the study of the global asymptotic dynamics of general coupled systems. Under the developed framework, the problem of establishing global synchronization or global convergence reduces to solving a corresponding system of linear equations. We illustrate this approach with a class of neural networks that consist of a pair of sub-networks under various types of nonlinear and delayed couplings. We study both the synchronization and the asymptotic synchronous phases of the dynamics, including global convergence to zero, global convergence to multiple synchronous equilibria, and global synchronization with nontrivial synchronous periodic solutions. Our investigation also provides theoretical support to some numerical findings, and improves or extend some results in the literature.
Citation: Jui-Pin Tseng. Global asymptotic dynamics of a class of nonlinearly coupled neural networks with delays. Discrete & Continuous Dynamical Systems - A, 2013, 33 (10) : 4693-4729. doi: 10.3934/dcds.2013.33.4693
References:
[1]

F. M. Atay, Oscillator death in coupled functional differential equations near Hopf bifurcation,, J. Differential Equations, 221 (2003), 190. doi: 10.1016/j.jde.2005.01.007.

[2]

I. Belykh, M. Hasler, M. Lauret and H. Nijmeijer, Synchronization and graph topology,, Internat. J. Bifur. Chaos, 15 (2005), 3423. doi: 10.1142/S0218127405014143.

[3]

N. Buric and D. Todorovic, Dynamics of Fitzhugh-Nagumo excitable systems with delayed coupling,, Phys. Rev. E, 67 (2003). doi: 10.1103/PhysRevE.67.066222.

[4]

S. A. Campbell, Time delays in neural systems,, Handbook of Brain Connectivity, (2007), 65. doi: 10.1007/978-3-540-71512-2_2.

[5]

S. A. Campbell, R. Edwards and P. van den Driessche, Delayed coupling between two neural networks loops,, SIAM J. Appl. Math., 65 (2004), 316. doi: 10.1137/S0036139903434833.

[6]

S. A. Campbell, I. Ncube and J. Wu, Multistability and stable asynchronous periodic oscillations in a multiple-delayed neural system,, Phys. D, 214 (2006), 101. doi: 10.1016/j.physd.2005.12.008.

[7]

S. A. Campbell, Y. Yuan and S. D. Bungay, Equivariant Hopf bifurcation in a ring of identical cells with delayed coupling,, Nonlinearity, 18 (2005), 2827. doi: 10.1088/0951-7715/18/6/022.

[8]

Y. C. Chang and J. Juang, Stable synchrony in globally-coupled integrate-and-fire oscillators,, SIAM Appl. Dynam. Systems, 7 (2008), 1445. doi: 10.1137/070709220.

[9]

S. M. Crook, G. B. Ermentrout, M. C. Vanier and J. M. Bower, The role of axonal delay in the synchronization of networks of coupled cortical oscillators,, J. Comput. Neurosci., 4 (1997), 161.

[10]

P. Grosse, M. J. Cassidy and P. Brown, MEG-EMG and EMG-EMG frequency analysis: Physiological principles and clinical applications,, Clin. Neurophysiol, 113 (2002), 1523. doi: 10.1016/S1388-2457(02)00223-7.

[11]

S. Guo, Spatio-temporal patterns of nonlinear oscillations in an excitatory ring network with delay,, Nonlinearity, 18 (2005), 2391. doi: 10.1088/0951-7715/18/5/027.

[12]

B. D. Hassard, N. D. Kazarinoff and Y. H. Wan, "Theory and Applications of Hopf Bifurcation,", London Math. Socl. Lecture Note Series 41, (1981).

[13]

H. S. Hsu and T. S Yang, Periodic oscillations arising and death in delay-coupled neural loops,, Intern. J. of Bifurc. and Chaos, 17 (2007), 4015. doi: 10.1142/S0218127407019834.

[14]

J. Juang, C.-L. Li and Y.-H. Liang, Global synchronization in lattices of coupled chaotic systems,, Chaos, 17 (2007). doi: 10.1063/1.2754668.

[15]

R. E. Kalaba and K. Spingarn, A criterion for the convergence of the Gauss-Seidel method,, Appl. Math. Comput., 4 (1978), 359. doi: 10.1016/0096-3003(78)90004-8.

[16]

J. Karbowski and N. Kopell, Multispikes and synchronization in a large neural network with temporal delays,, Neural Comput., 12 (2000), 1573. doi: 10.1162/089976600300015277.

[17]

N. Kopell, G. B. Ermentrout, M. A. Whittington and R. Traub, Gamma rhythms and beta rhythms have different synchronization properties,, Proc. Natl. Acad. Sci. USA, 97 (2000), 1867. doi: 10.1073/pnas.97.4.1867.

[18]

K.-L. Liao, C.-W. Shih and J.-P. Tseng, Synchronized oscillations in a mathematical model of segmentation in zebrafish,, Nonlinearity, 25 (2012), 869. doi: 10.1088/0951-7715/25/4/869.

[19]

X. Liu and T. Chen, Exponential synchronization of nonlinear coupled dynamical networks with a delayed coupling,, Phys. A, 381 (2007), 82. doi: 10.1016/j.physa.2007.03.026.

[20]

A. C. Marti and C. Masoller, Delay-induced synchronization phenomena in an array of globally coupled logistic maps,, Phys. Rev. E, 67 (2003). doi: 10.1103/PhysRevE.67.056219.

[21]

C. S. Peskin, "Mathematical Aspects of Heart Physiology,", Courant Institute of Mathematical Science, (1975).

[22]

M. Porfiri and R. Pigliacampo, Master-slave global stochastic synchronization of chaotic oscillators,, SIAM Appl. Dynam. Systems, 7 (2008), 825. doi: 10.1137/070688973.

[23]

C.-W. Shih and J.-P.Tseng, Convergent dynamics for multistable delayed neural networks,, Nonlinearity, 21 (2008), 2361. doi: 10.1088/0951-7715/21/10/009.

[24]

C.-W.Shih and J.-P. Tseng, Global synchronization and asymptotic phases for a ring of identical cells with delayed coupling,, SIAM J. Math. Anal., 43 (2011), 1667. doi: 10.1137/10080885X.

[25]

J.-J. E. Slotine, W. Wang and K. E. Rifai, Contraction analysis of synchronization in networks of nonlinearly coupled oscillators,, in, (2004).

[26]

Y. Song, M. Tade and T. Zhang, Bifurcation analysis and spatio-temporal patterns of nonlinear oscillations in a delayed neural network with unidirectional coupling,, Nonlinearity, 22 (2009), 975. doi: 10.1088/0951-7715/22/5/004.

[27]

Y. Song, T. Zhang and M. O. Tade, Stability switches, Hopf bifurcations, and spatio-temporal patterns in a delayed neural model with bidirectional coupling,, J. Nonlinear Sci., (2009), 597. doi: 10.1007/s00332-009-9046-1.

[28]

E. Steur, I. Tyukin and H. Nijmeijer, Semi-passivity and synchronization of diffusively coupled neuronal oscillators,, Phys. D, 238 (2009), 2119. doi: 10.1016/j.physd.2009.08.007.

[29]

S. H. Strogatz and I. Stewart, Coupled oscillators and biological synchronization,, Scientific American, 269 (1993), 102. doi: 10.1038/scientificamerican1293-102.

[30]

X.-J. Wang and G. Buzsaki, Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model,, J. Neuroscience, 16 (1998), 6.

[31]

X.-F. Wang and G. Chen, Synchronization in small-world dynamical networks,, Internat. J. Bifur. Chaos, 12 (2002), 187. doi: 10.1142/S0218127402004292.

[32]

J. White, C. Chow, J. Ritt, C. Soto-Trenivo and N. Kopell White, Synchronization and oscillaory dynamics in heterogeneous, mutually inhibited neurons,, J. Comput. Neurosci., 5 (1998), 5.

[33]

J. Wu, Symmetric functional differential equations and neural networks with memory,, Tansactions of American Mathematical Society, 350 (1998), 4799. doi: 10.1090/S0002-9947-98-02083-2.

[34]

K. Xiao and S. Guo, Synchronization for two coupled oscillators with inhibitory connection,, Math. Methods Appl. Sci., 33 (2010), 892. doi: 10.1002/mma.1225.

[35]

Y. Yuan and S. A. Campbell, Stability and synchronization of a ring of identical cells with delayed coupling,, J. Dynam. Differential Equations, 16 (2004), 709. doi: 10.1007/s10884-004-6114-y.

[36]

W. Yu, J. Cao and J. Lu, Global synchronization of linearly hybrid coupled networks with time-varying delay,, SIAM Appl. Dynam. Systems, 7 (2007), 108. doi: 10.1137/070679090.

show all references

References:
[1]

F. M. Atay, Oscillator death in coupled functional differential equations near Hopf bifurcation,, J. Differential Equations, 221 (2003), 190. doi: 10.1016/j.jde.2005.01.007.

[2]

I. Belykh, M. Hasler, M. Lauret and H. Nijmeijer, Synchronization and graph topology,, Internat. J. Bifur. Chaos, 15 (2005), 3423. doi: 10.1142/S0218127405014143.

[3]

N. Buric and D. Todorovic, Dynamics of Fitzhugh-Nagumo excitable systems with delayed coupling,, Phys. Rev. E, 67 (2003). doi: 10.1103/PhysRevE.67.066222.

[4]

S. A. Campbell, Time delays in neural systems,, Handbook of Brain Connectivity, (2007), 65. doi: 10.1007/978-3-540-71512-2_2.

[5]

S. A. Campbell, R. Edwards and P. van den Driessche, Delayed coupling between two neural networks loops,, SIAM J. Appl. Math., 65 (2004), 316. doi: 10.1137/S0036139903434833.

[6]

S. A. Campbell, I. Ncube and J. Wu, Multistability and stable asynchronous periodic oscillations in a multiple-delayed neural system,, Phys. D, 214 (2006), 101. doi: 10.1016/j.physd.2005.12.008.

[7]

S. A. Campbell, Y. Yuan and S. D. Bungay, Equivariant Hopf bifurcation in a ring of identical cells with delayed coupling,, Nonlinearity, 18 (2005), 2827. doi: 10.1088/0951-7715/18/6/022.

[8]

Y. C. Chang and J. Juang, Stable synchrony in globally-coupled integrate-and-fire oscillators,, SIAM Appl. Dynam. Systems, 7 (2008), 1445. doi: 10.1137/070709220.

[9]

S. M. Crook, G. B. Ermentrout, M. C. Vanier and J. M. Bower, The role of axonal delay in the synchronization of networks of coupled cortical oscillators,, J. Comput. Neurosci., 4 (1997), 161.

[10]

P. Grosse, M. J. Cassidy and P. Brown, MEG-EMG and EMG-EMG frequency analysis: Physiological principles and clinical applications,, Clin. Neurophysiol, 113 (2002), 1523. doi: 10.1016/S1388-2457(02)00223-7.

[11]

S. Guo, Spatio-temporal patterns of nonlinear oscillations in an excitatory ring network with delay,, Nonlinearity, 18 (2005), 2391. doi: 10.1088/0951-7715/18/5/027.

[12]

B. D. Hassard, N. D. Kazarinoff and Y. H. Wan, "Theory and Applications of Hopf Bifurcation,", London Math. Socl. Lecture Note Series 41, (1981).

[13]

H. S. Hsu and T. S Yang, Periodic oscillations arising and death in delay-coupled neural loops,, Intern. J. of Bifurc. and Chaos, 17 (2007), 4015. doi: 10.1142/S0218127407019834.

[14]

J. Juang, C.-L. Li and Y.-H. Liang, Global synchronization in lattices of coupled chaotic systems,, Chaos, 17 (2007). doi: 10.1063/1.2754668.

[15]

R. E. Kalaba and K. Spingarn, A criterion for the convergence of the Gauss-Seidel method,, Appl. Math. Comput., 4 (1978), 359. doi: 10.1016/0096-3003(78)90004-8.

[16]

J. Karbowski and N. Kopell, Multispikes and synchronization in a large neural network with temporal delays,, Neural Comput., 12 (2000), 1573. doi: 10.1162/089976600300015277.

[17]

N. Kopell, G. B. Ermentrout, M. A. Whittington and R. Traub, Gamma rhythms and beta rhythms have different synchronization properties,, Proc. Natl. Acad. Sci. USA, 97 (2000), 1867. doi: 10.1073/pnas.97.4.1867.

[18]

K.-L. Liao, C.-W. Shih and J.-P. Tseng, Synchronized oscillations in a mathematical model of segmentation in zebrafish,, Nonlinearity, 25 (2012), 869. doi: 10.1088/0951-7715/25/4/869.

[19]

X. Liu and T. Chen, Exponential synchronization of nonlinear coupled dynamical networks with a delayed coupling,, Phys. A, 381 (2007), 82. doi: 10.1016/j.physa.2007.03.026.

[20]

A. C. Marti and C. Masoller, Delay-induced synchronization phenomena in an array of globally coupled logistic maps,, Phys. Rev. E, 67 (2003). doi: 10.1103/PhysRevE.67.056219.

[21]

C. S. Peskin, "Mathematical Aspects of Heart Physiology,", Courant Institute of Mathematical Science, (1975).

[22]

M. Porfiri and R. Pigliacampo, Master-slave global stochastic synchronization of chaotic oscillators,, SIAM Appl. Dynam. Systems, 7 (2008), 825. doi: 10.1137/070688973.

[23]

C.-W. Shih and J.-P.Tseng, Convergent dynamics for multistable delayed neural networks,, Nonlinearity, 21 (2008), 2361. doi: 10.1088/0951-7715/21/10/009.

[24]

C.-W.Shih and J.-P. Tseng, Global synchronization and asymptotic phases for a ring of identical cells with delayed coupling,, SIAM J. Math. Anal., 43 (2011), 1667. doi: 10.1137/10080885X.

[25]

J.-J. E. Slotine, W. Wang and K. E. Rifai, Contraction analysis of synchronization in networks of nonlinearly coupled oscillators,, in, (2004).

[26]

Y. Song, M. Tade and T. Zhang, Bifurcation analysis and spatio-temporal patterns of nonlinear oscillations in a delayed neural network with unidirectional coupling,, Nonlinearity, 22 (2009), 975. doi: 10.1088/0951-7715/22/5/004.

[27]

Y. Song, T. Zhang and M. O. Tade, Stability switches, Hopf bifurcations, and spatio-temporal patterns in a delayed neural model with bidirectional coupling,, J. Nonlinear Sci., (2009), 597. doi: 10.1007/s00332-009-9046-1.

[28]

E. Steur, I. Tyukin and H. Nijmeijer, Semi-passivity and synchronization of diffusively coupled neuronal oscillators,, Phys. D, 238 (2009), 2119. doi: 10.1016/j.physd.2009.08.007.

[29]

S. H. Strogatz and I. Stewart, Coupled oscillators and biological synchronization,, Scientific American, 269 (1993), 102. doi: 10.1038/scientificamerican1293-102.

[30]

X.-J. Wang and G. Buzsaki, Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model,, J. Neuroscience, 16 (1998), 6.

[31]

X.-F. Wang and G. Chen, Synchronization in small-world dynamical networks,, Internat. J. Bifur. Chaos, 12 (2002), 187. doi: 10.1142/S0218127402004292.

[32]

J. White, C. Chow, J. Ritt, C. Soto-Trenivo and N. Kopell White, Synchronization and oscillaory dynamics in heterogeneous, mutually inhibited neurons,, J. Comput. Neurosci., 5 (1998), 5.

[33]

J. Wu, Symmetric functional differential equations and neural networks with memory,, Tansactions of American Mathematical Society, 350 (1998), 4799. doi: 10.1090/S0002-9947-98-02083-2.

[34]

K. Xiao and S. Guo, Synchronization for two coupled oscillators with inhibitory connection,, Math. Methods Appl. Sci., 33 (2010), 892. doi: 10.1002/mma.1225.

[35]

Y. Yuan and S. A. Campbell, Stability and synchronization of a ring of identical cells with delayed coupling,, J. Dynam. Differential Equations, 16 (2004), 709. doi: 10.1007/s10884-004-6114-y.

[36]

W. Yu, J. Cao and J. Lu, Global synchronization of linearly hybrid coupled networks with time-varying delay,, SIAM Appl. Dynam. Systems, 7 (2007), 108. doi: 10.1137/070679090.

[1]

Rui Hu, Yuan Yuan. Stability, bifurcation analysis in a neural network model with delay and diffusion. Conference Publications, 2009, 2009 (Special) : 367-376. doi: 10.3934/proc.2009.2009.367

[2]

Fang Han, Bin Zhen, Ying Du, Yanhong Zheng, Marian Wiercigroch. Global Hopf bifurcation analysis of a six-dimensional FitzHugh-Nagumo neural network with delay by a synchronized scheme. Discrete & Continuous Dynamical Systems - B, 2011, 16 (2) : 457-474. doi: 10.3934/dcdsb.2011.16.457

[3]

Jianfeng Feng, Mariya Shcherbina, Brunello Tirozzi. Stability of the dynamics of an asymmetric neural network. Communications on Pure & Applied Analysis, 2009, 8 (2) : 655-671. doi: 10.3934/cpaa.2009.8.655

[4]

Stefano Fasani, Sergio Rinaldi. Local stabilization and network synchronization: The case of stationary regimes. Mathematical Biosciences & Engineering, 2010, 7 (3) : 623-639. doi: 10.3934/mbe.2010.7.623

[5]

Tingting Su, Xinsong Yang. Finite-time synchronization of competitive neural networks with mixed delays. Discrete & Continuous Dynamical Systems - B, 2016, 21 (10) : 3655-3667. doi: 10.3934/dcdsb.2016115

[6]

Ying Sue Huang, Chai Wah Wu. Stability of cellular neural network with small delays. Conference Publications, 2005, 2005 (Special) : 420-426. doi: 10.3934/proc.2005.2005.420

[7]

King Hann Lim, Hong Hui Tan, Hendra G. Harno. Approximate greatest descent in neural network optimization. Numerical Algebra, Control & Optimization, 2018, 8 (3) : 327-336. doi: 10.3934/naco.2018021

[8]

Shyan-Shiou Chen, Chih-Wen Shih. Asymptotic behaviors in a transiently chaotic neural network. Discrete & Continuous Dynamical Systems - A, 2004, 10 (3) : 805-826. doi: 10.3934/dcds.2004.10.805

[9]

Ndolane Sene. Fractional input stability and its application to neural network. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 853-865. doi: 10.3934/dcdss.2020049

[10]

Shahad Al-azzawi, Jicheng Liu, Xianming Liu. Convergence rate of synchronization of systems with additive noise. Discrete & Continuous Dynamical Systems - B, 2017, 22 (2) : 227-245. doi: 10.3934/dcdsb.2017012

[11]

Chun-Hsiung Hsia, Chang-Yeol Jung, Bongsuk Kwon. On the global convergence of frequency synchronization for Kuramoto and Winfree oscillators. Discrete & Continuous Dynamical Systems - B, 2019, 24 (7) : 3319-3334. doi: 10.3934/dcdsb.2018322

[12]

Benedetta Lisena. Average criteria for periodic neural networks with delay. Discrete & Continuous Dynamical Systems - B, 2014, 19 (3) : 761-773. doi: 10.3934/dcdsb.2014.19.761

[13]

Hui-Qiang Ma, Nan-Jing Huang. Neural network smoothing approximation method for stochastic variational inequality problems. Journal of Industrial & Management Optimization, 2015, 11 (2) : 645-660. doi: 10.3934/jimo.2015.11.645

[14]

Yixin Guo, Aijun Zhang. Existence and nonexistence of traveling pulses in a lateral inhibition neural network. Discrete & Continuous Dynamical Systems - B, 2016, 21 (6) : 1729-1755. doi: 10.3934/dcdsb.2016020

[15]

Jianhong Wu, Ruyuan Zhang. A simple delayed neural network with large capacity for associative memory. Discrete & Continuous Dynamical Systems - B, 2004, 4 (3) : 851-863. doi: 10.3934/dcdsb.2004.4.851

[16]

Sanjay K. Mazumdar, Cheng-Chew Lim. A neural network based anti-skid brake system. Discrete & Continuous Dynamical Systems - A, 1999, 5 (2) : 321-338. doi: 10.3934/dcds.1999.5.321

[17]

K. L. Mak, J. G. Peng, Z. B. Xu, K. F. C. Yiu. A novel neural network for associative memory via dynamical systems. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 573-590. doi: 10.3934/dcdsb.2006.6.573

[18]

Honggang Yu. An efficient face recognition algorithm using the improved convolutional neural network. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 901-914. doi: 10.3934/dcdss.2019060

[19]

Lidong Liu, Fajie Wei, Shenghan Zhou. Major project risk assessment method based on BP neural network. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 1053-1064. doi: 10.3934/dcdss.2019072

[20]

Zhuwei Qin, Fuxun Yu, Chenchen Liu, Xiang Chen. How convolutional neural networks see the world --- A survey of convolutional neural network visualization methods. Mathematical Foundations of Computing, 2018, 1 (2) : 149-180. doi: 10.3934/mfc.2018008

2017 Impact Factor: 1.179

Metrics

  • PDF downloads (8)
  • HTML views (0)
  • Cited by (4)

Other articles
by authors

[Back to Top]