American Institute of Mathematical Sciences

Advanced
doi: 10.3934/era.2020112

Pullback attractors for stochastic recurrent neural networks with discrete and distributed delays

Meiyu Sui 1, , Yejuan Wang 1,, and  Peter E. Kloeden 2,

1. 

School of Mathematics and Statistics, Gansu Key Laboratory of Applied Mathematics and Complex Systems, Lanzhou University, Lanzhou 730000, China
2. 

Mathematisches Institut, Universität Tübingen, Tübingen 72076, Germany

* Corresponding author: Yejuan Wang

Received  April 2020 Revised  August 2020 Published  October 2020

Fund Project: This work was supported by NSF of China (Grant Nos. 41875084, 11571153), the Fundamental Research Funds for the Central Universities under Grant Nos. lzujbky-2018-it58 and lzujbky-2018-ot03

In this paper, we investigate a class of stochastic recurrent neural networks with discrete and distributed delays for both biological and mathematical interests. We do not assume any Lipschitz condition on the nonlinear term, just a continuity assumption together with growth conditions so that the uniqueness of the Cauchy problem fails to be true. Moreover, the existence of pullback attractors with or without periodicity is presented for the multi-valued noncompact random dynamical system. In particular, a new method for checking the asymptotical compactness of solutions to the class of nonautonomous stochastic lattice systems with infinite delay is used.

Keywords: Pullback attractor, multi-valued dynamical system, stochastic recurrent neural networks, variable delays, unbounded delays.
Mathematics Subject Classification: Primary: 34A33; Secondary: 34D45, 34F05.
Citation: Meiyu Sui, Yejuan Wang, Peter E. Kloeden. Pullback attractors for stochastic recurrent neural networks with discrete and distributed delays. Electronic Research Archive, doi: 10.3934/era.2020112
References:
[1]

J.-P. Aubin and H. Franskowska, Set-Valued Analysis, Systems & Control: Foundations & Applications, 2. Birkhäuser Boston, Inc., Boston, MA, 1990.  Google Scholar

[2]

P. Balasubramaniam and R. Rakkiyappan, Global asymptotic stability of stochastic recurrent neural networks with multiple discrete delays and unbounded distributed delays, Appl. Math. Comput., 204 (2008), 680-686.  doi: 10.1016/j.amc.2008.05.001.  Google Scholar

[3]

T. Caraballo, M. J. Garrido-Atienza, B. Schmalfuss and J. Valero, Non-autonomous and random attractors for delay random semilinear equations without uniqueness, Discrete Contin. Dyn. Syst., 21 (2008), 415-443.  doi: 10.3934/dcds.2008.21.415.  Google Scholar

[4]

T. Caraballo, F. Morillas and J. Valero, Pullback attractors of stochastic lattice dynamical systems with a multiplicative noise and non-Lipschitz nonlinearities, Differential and Difference Equations with Applications, Springer Proc. Math. Stat., Springer, New York, 47 (2013), 341-349. doi: 10.1007/978-1-4614-7333-6_27.  Google Scholar

[5]

T. Caraballo, F. Morillas and J. Valero, On differential equations with delay in Banach spaces and attractors for retarded lattice dynamical systems, Discrete Contin. Dyn. Syst., 34 (2014), 51-77.  doi: 10.3934/dcds.2014.34.51.  Google Scholar

[6]

D. N. Cheban, Global Attractors of Non-Autonomous Dissipative Dynamical Systems: Interdisciplinary Mathematical Sciences, 1, World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2004. doi: 10.1142/9789812563088.  Google Scholar

[7]

T. Chen, Global exponential stability of delayed Hopfield neural networks, Neural Netw., 14 (2001), 977-980.   Google Scholar

[8]

G. Chen, D. Li, L. Shi, O. van Gaans and S. Verduyn Lunel, Stability results for stochastic delayed recurrent neural networks with discrete and distributed delays, J. Differential Equations, 264 (2018), 3864-3898.  doi: 10.1016/j.jde.2017.11.032.  Google Scholar

[9]

A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing, Wiley, Chichester, 1993. Google Scholar

[10]

H. Crauel and F. Flandoli, Attractors for random dynamical systems, Probab. Theory Related Fields, 100 (1994), 365-393.  doi: 10.1007/BF01193705.  Google Scholar

[11]

F. Flandoli and B. Schmalfuss, Random attractors for the $3$D stochastic Navier-Stokes equation with multiplicative white noise, Stochast. Stochast. Rep., 59 (1996), 21-45.  doi: 10.1080/17442509608834083.  Google Scholar

[12]

Y. Guo, Mean square global asymptotic stability of stochastic recurrent neural networks with distributed delays, Appl. Math. Comput., 215 (2009), 791-795.  doi: 10.1016/j.amc.2009.06.002.  Google Scholar

[13]

X. Han and P. E. Kloeden, Non-autonomous lattice systems with switching effects and delayed recovery, J. Differential Equations, 261 (2016), 2986-3009.  doi: 10.1016/j.jde.2016.05.015.  Google Scholar

[14]

S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice-Hall, Englewood Cliffs, 1994. Google Scholar

[15]

J. Hu, S. Zhong and L. Liang, Exponential stability analysis of stochastic delayed cellular neural network, Chaos Solitons Fractals, 27 (2006), 1006-1010.  doi: 10.1016/j.chaos.2005.04.067.  Google Scholar

[16]

C. Huang, Y. He and H. Wang, Mean square exponential stability of stochastic recurrent neural networks with time-varying delays, Comput. Math. Appl., 56 (2008), 1773-1778.  doi: 10.1016/j.camwa.2008.04.004.  Google Scholar

[17]

P. E. Kloeden, Pullback attractors of nonautonomous semidynamical systems, Stoch. Dyn., 3 (2003), 101-112.  doi: 10.1142/S0219493703000632.  Google Scholar

[18]

X. Li and X. Fu, Stability analysis of stochastic functional differential equations with infinite delay and its application to recurrent neural networks, J. Comput. Appl. Math., 234 (2010), 407-417.  doi: 10.1016/j.cam.2009.12.033.  Google Scholar

[19]

X. Li, F. Li, X. Zhang, C. Yang and W. Gui, Exponential stability analysis for delayed semi-Markovian recurrent neural networks: A homogeneous polynomial approach, IEEE Trans. Neural Netw. Learn. Syst., 29 (2018), 6374-6384.  doi: 10.1109/TNNLS.2018.2830789.  Google Scholar

[20]

G. Nagamani, S. Ramasamy and P. Balasubramaniam, Robust dissipativity and passivity analysis for discrete-time stochastic neural networks with time-varying delay, Complexity, 21 (2015), 47-58.  doi: 10.1002/cplx.21614.  Google Scholar

[21]

G. Peng and L. Huang, Exponential stability of hybrid stochastic recurrent neural networks with time-varying delays, Nonlinear Anal. Hybrid Syst., 2 (2008), 1198-1204.  doi: 10.1016/j.nahs.2008.09.012.  Google Scholar

[22]

T. Roska and L. O. Chua, Cellular neural networks with nonlinear and delay-type template elements and non-uniform grids, Int. J. Circuit Theory Appl., 20 (1992), 469-481.   Google Scholar

[23]

R. Sakthivel, R. Samidurai and S. M. Anthoni, Asymptotic stability of stochastic delayed recurrent neural networks with impulsive effects, J. Optim. Theory Appl., 147 (2010), 583-596.  doi: 10.1007/s10957-010-9728-8.  Google Scholar

[24]

B. Schmalfuss, Measure Attractors of the Stochastic Navier-Stokes Equation, Report 258, Universität Bremen, Fachbereiche Mathematik/Informatik, Elektrotechnik/Physik, Forschungsschwerpunkt Dynamische Systeme, Bremen, 1991. Google Scholar

[25]

Y. Sun and J. Cao, $P$th moment exponential stability of stochastic recurrent neural networks with time-varying delays, Nonlinear Anal. Real World Appl., 8 (2007), 1171-1185.  doi: 10.1016/j.nonrwa.2006.06.009.  Google Scholar

[26]

M. Syed Ali and M. Marudai, Stochastic stability of discrete-time uncertain recurrent neural networks with Markovian jumping and time-varying delays, Math. Comput. Modelling, 54 (2011), 1979-1988.  doi: 10.1016/j.mcm.2011.05.004.  Google Scholar

[27]

M. Syed Ali, Stochastic stability of uncertain recurrent neural networks with Markovian jumping parameters, Acta Math. Sci. Ser. B, 35 (2015), 1122-1136.  doi: 10.1016/S0252-9602(15)30044-8.  Google Scholar

[28]

P. Venetianer and T. Roska, Image compression by delayed CNNs, IEEE Trans. Circuits Syst. I, 45 (1998), 205-215.   Google Scholar

[29]

C. Vidhya, S. Dharani and P. Balasubramaniam, Global asymptotic stability of stochastic reaction-diffusion recurrent neural networks with Markovian jumping parameters and mixed delays, J. Anal., 27 (2019), 277-292.  doi: 10.1007/s41478-018-0123-4.  Google Scholar

[30]

L. Wan and Q. Zhou, Almost sure exponential stability of stochastic recurrent neural networks with time-varying delays, Internat. J. Bifur. Chaos Appl. Sci. Engrg., 20 (2010), 539-544.  doi: 10.1142/S0218127410025594.  Google Scholar

[31]

B. Wang, Sufficient and necessary criteria for existence of pullback attractors for non-compact random dynamical systems, J. Differential Equations, 253 (2012), 1544-1583. doi: 10.1016/j.jde.2012.05.015.  Google Scholar

[32]

Y. Wang and M. Sui, Finite lattice approximation of infinite lattice systems with delays and non-Lipschitz nonlinearities, Asymptot. Anal., 106 (2018), 169-203.  doi: 10.3233/ASY-171444.  Google Scholar

[33]

Y. Wang and J. Wang, Pullback attractors for multi-valued non-compact random dynamical systems generated by reaction-diffusion equations on an unbounded domain, J. Differential Equations, 259 (2015), 728-776.  doi: 10.1016/j.jde.2015.02.026.  Google Scholar

[34]

J. Wang, Y. Wang and D. Zhao, Pullback attractors for multi-valued non-compact random dynamical systems generated by semi-linear degenerate parabolic equations with unbounded delays, Stoch. Dyn., 16 (2016), 1750001, 49 pp. doi: 10.1142/S0219493717500010.  Google Scholar

[35]

S. Zhu, W. Luo and Y. Shen, Robustness analysis for connection weight matrices of global exponential stability of stochastic delayed recurrent neural networks, Circuits Systems Signal Process, 33 (2014), 2065-2083.  doi: 10.1007/s00034-013-9735-8.  Google Scholar

show all references

References:
[1]

J.-P. Aubin and H. Franskowska, Set-Valued Analysis, Systems & Control: Foundations & Applications, 2. Birkhäuser Boston, Inc., Boston, MA, 1990.  Google Scholar

[2]

P. Balasubramaniam and R. Rakkiyappan, Global asymptotic stability of stochastic recurrent neural networks with multiple discrete delays and unbounded distributed delays, Appl. Math. Comput., 204 (2008), 680-686.  doi: 10.1016/j.amc.2008.05.001.  Google Scholar

[3]

T. Caraballo, M. J. Garrido-Atienza, B. Schmalfuss and J. Valero, Non-autonomous and random attractors for delay random semilinear equations without uniqueness, Discrete Contin. Dyn. Syst., 21 (2008), 415-443.  doi: 10.3934/dcds.2008.21.415.  Google Scholar

[4]

T. Caraballo, F. Morillas and J. Valero, Pullback attractors of stochastic lattice dynamical systems with a multiplicative noise and non-Lipschitz nonlinearities, Differential and Difference Equations with Applications, Springer Proc. Math. Stat., Springer, New York, 47 (2013), 341-349. doi: 10.1007/978-1-4614-7333-6_27.  Google Scholar

[5]

T. Caraballo, F. Morillas and J. Valero, On differential equations with delay in Banach spaces and attractors for retarded lattice dynamical systems, Discrete Contin. Dyn. Syst., 34 (2014), 51-77.  doi: 10.3934/dcds.2014.34.51.  Google Scholar

[6]

D. N. Cheban, Global Attractors of Non-Autonomous Dissipative Dynamical Systems: Interdisciplinary Mathematical Sciences, 1, World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2004. doi: 10.1142/9789812563088.  Google Scholar

[7]

T. Chen, Global exponential stability of delayed Hopfield neural networks, Neural Netw., 14 (2001), 977-980.   Google Scholar

[8]

G. Chen, D. Li, L. Shi, O. van Gaans and S. Verduyn Lunel, Stability results for stochastic delayed recurrent neural networks with discrete and distributed delays, J. Differential Equations, 264 (2018), 3864-3898.  doi: 10.1016/j.jde.2017.11.032.  Google Scholar

[9]

A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing, Wiley, Chichester, 1993. Google Scholar

[10]

H. Crauel and F. Flandoli, Attractors for random dynamical systems, Probab. Theory Related Fields, 100 (1994), 365-393.  doi: 10.1007/BF01193705.  Google Scholar

[11]

F. Flandoli and B. Schmalfuss, Random attractors for the $3$D stochastic Navier-Stokes equation with multiplicative white noise, Stochast. Stochast. Rep., 59 (1996), 21-45.  doi: 10.1080/17442509608834083.  Google Scholar

[12]

Y. Guo, Mean square global asymptotic stability of stochastic recurrent neural networks with distributed delays, Appl. Math. Comput., 215 (2009), 791-795.  doi: 10.1016/j.amc.2009.06.002.  Google Scholar

[13]

X. Han and P. E. Kloeden, Non-autonomous lattice systems with switching effects and delayed recovery, J. Differential Equations, 261 (2016), 2986-3009.  doi: 10.1016/j.jde.2016.05.015.  Google Scholar

[14]

S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice-Hall, Englewood Cliffs, 1994. Google Scholar

[15]

J. Hu, S. Zhong and L. Liang, Exponential stability analysis of stochastic delayed cellular neural network, Chaos Solitons Fractals, 27 (2006), 1006-1010.  doi: 10.1016/j.chaos.2005.04.067.  Google Scholar

[16]

C. Huang, Y. He and H. Wang, Mean square exponential stability of stochastic recurrent neural networks with time-varying delays, Comput. Math. Appl., 56 (2008), 1773-1778.  doi: 10.1016/j.camwa.2008.04.004.  Google Scholar

[17]

P. E. Kloeden, Pullback attractors of nonautonomous semidynamical systems, Stoch. Dyn., 3 (2003), 101-112.  doi: 10.1142/S0219493703000632.  Google Scholar

[18]

X. Li and X. Fu, Stability analysis of stochastic functional differential equations with infinite delay and its application to recurrent neural networks, J. Comput. Appl. Math., 234 (2010), 407-417.  doi: 10.1016/j.cam.2009.12.033.  Google Scholar

[19]

X. Li, F. Li, X. Zhang, C. Yang and W. Gui, Exponential stability analysis for delayed semi-Markovian recurrent neural networks: A homogeneous polynomial approach, IEEE Trans. Neural Netw. Learn. Syst., 29 (2018), 6374-6384.  doi: 10.1109/TNNLS.2018.2830789.  Google Scholar

[20]

G. Nagamani, S. Ramasamy and P. Balasubramaniam, Robust dissipativity and passivity analysis for discrete-time stochastic neural networks with time-varying delay, Complexity, 21 (2015), 47-58.  doi: 10.1002/cplx.21614.  Google Scholar

[21]

G. Peng and L. Huang, Exponential stability of hybrid stochastic recurrent neural networks with time-varying delays, Nonlinear Anal. Hybrid Syst., 2 (2008), 1198-1204.  doi: 10.1016/j.nahs.2008.09.012.  Google Scholar

[22]

T. Roska and L. O. Chua, Cellular neural networks with nonlinear and delay-type template elements and non-uniform grids, Int. J. Circuit Theory Appl., 20 (1992), 469-481.   Google Scholar

[23]

R. Sakthivel, R. Samidurai and S. M. Anthoni, Asymptotic stability of stochastic delayed recurrent neural networks with impulsive effects, J. Optim. Theory Appl., 147 (2010), 583-596.  doi: 10.1007/s10957-010-9728-8.  Google Scholar

[24]

B. Schmalfuss, Measure Attractors of the Stochastic Navier-Stokes Equation, Report 258, Universität Bremen, Fachbereiche Mathematik/Informatik, Elektrotechnik/Physik, Forschungsschwerpunkt Dynamische Systeme, Bremen, 1991. Google Scholar

[25]

Y. Sun and J. Cao, $P$th moment exponential stability of stochastic recurrent neural networks with time-varying delays, Nonlinear Anal. Real World Appl., 8 (2007), 1171-1185.  doi: 10.1016/j.nonrwa.2006.06.009.  Google Scholar

[26]

M. Syed Ali and M. Marudai, Stochastic stability of discrete-time uncertain recurrent neural networks with Markovian jumping and time-varying delays, Math. Comput. Modelling, 54 (2011), 1979-1988.  doi: 10.1016/j.mcm.2011.05.004.  Google Scholar

[27]

M. Syed Ali, Stochastic stability of uncertain recurrent neural networks with Markovian jumping parameters, Acta Math. Sci. Ser. B, 35 (2015), 1122-1136.  doi: 10.1016/S0252-9602(15)30044-8.  Google Scholar

[28]

P. Venetianer and T. Roska, Image compression by delayed CNNs, IEEE Trans. Circuits Syst. I, 45 (1998), 205-215.   Google Scholar

[29]

C. Vidhya, S. Dharani and P. Balasubramaniam, Global asymptotic stability of stochastic reaction-diffusion recurrent neural networks with Markovian jumping parameters and mixed delays, J. Anal., 27 (2019), 277-292.  doi: 10.1007/s41478-018-0123-4.  Google Scholar

[30]

L. Wan and Q. Zhou, Almost sure exponential stability of stochastic recurrent neural networks with time-varying delays, Internat. J. Bifur. Chaos Appl. Sci. Engrg., 20 (2010), 539-544.  doi: 10.1142/S0218127410025594.  Google Scholar

[31]

B. Wang, Sufficient and necessary criteria for existence of pullback attractors for non-compact random dynamical systems, J. Differential Equations, 253 (2012), 1544-1583. doi: 10.1016/j.jde.2012.05.015.  Google Scholar

[32]

Y. Wang and M. Sui, Finite lattice approximation of infinite lattice systems with delays and non-Lipschitz nonlinearities, Asymptot. Anal., 106 (2018), 169-203.  doi: 10.3233/ASY-171444.  Google Scholar

[33]

Y. Wang and J. Wang, Pullback attractors for multi-valued non-compact random dynamical systems generated by reaction-diffusion equations on an unbounded domain, J. Differential Equations, 259 (2015), 728-776.  doi: 10.1016/j.jde.2015.02.026.  Google Scholar

[34]

J. Wang, Y. Wang and D. Zhao, Pullback attractors for multi-valued non-compact random dynamical systems generated by semi-linear degenerate parabolic equations with unbounded delays, Stoch. Dyn., 16 (2016), 1750001, 49 pp. doi: 10.1142/S0219493717500010.  Google Scholar

[35]

S. Zhu, W. Luo and Y. Shen, Robustness analysis for connection weight matrices of global exponential stability of stochastic delayed recurrent neural networks, Circuits Systems Signal Process, 33 (2014), 2065-2083.  doi: 10.1007/s00034-013-9735-8.  Google Scholar

[1]

Stefan Ruschel, Serhiy Yanchuk. The spectrum of delay differential equations with multiple hierarchical large delays. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 151-175. doi: 10.3934/dcdss.2020321
[2]

Xinyu Mei, Yangmin Xiong, Chunyou Sun. Pullback attractor for a weakly damped wave equation with sup-cubic nonlinearity. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 569-600. doi: 10.3934/dcds.2020270
[3]

Shasha Hu, Yihong Xu, Yuhan Zhang. Second-Order characterizations for set-valued equilibrium problems with variable ordering structures. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020164
[4]

Fanni M. Sélley. A self-consistent dynamical system with multiple absolutely continuous invariant measures. Journal of Computational Dynamics, 2021, 8 (1) : 9-32. doi: 10.3934/jcd.2021002
[5]

Lin Shi, Xuemin Wang, Dingshi Li. Limiting behavior of non-autonomous stochastic reaction-diffusion equations with colored noise on unbounded thin domains. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5367-5386. doi: 10.3934/cpaa.2020242
[6]

Fathalla A. Rihan, Hebatallah J. Alsakaji. Stochastic delay differential equations of three-species prey-predator system with cooperation among prey species. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020468
[7]

Jianhua Huang, Yanbin Tang, Ming Wang. Singular support of the global attractor for a damped BBM equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020345
[8]

Lingwei Ma, Zhenqiu Zhang. Monotonicity for fractional Laplacian systems in unbounded Lipschitz domains. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 537-552. doi: 10.3934/dcds.2020268
[9]

D. R. Michiel Renger, Johannes Zimmer. Orthogonality of fluxes in general nonlinear reaction networks. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 205-217. doi: 10.3934/dcdss.2020346
[10]

Bernold Fiedler. Global Hopf bifurcation in networks with fast feedback cycles. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 177-203. doi: 10.3934/dcdss.2020344
[11]

Jiahao Qiu, Jianjie Zhao. Maximal factors of order $ d $ of dynamical cubespaces. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 601-620. doi: 10.3934/dcds.2020278
[12]

Xin-Guang Yang, Lu Li, Xingjie Yan, Ling Ding. The structure and stability of pullback attractors for 3D Brinkman-Forchheimer equation with delay. Electronic Research Archive, 2020, 28 (4) : 1395-1418. doi: 10.3934/era.2020074
[13]

Hirokazu Ninomiya. Entire solutions of the Allen–Cahn–Nagumo equation in a multi-dimensional space. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 395-412. doi: 10.3934/dcds.2020364
[14]

Shun Zhang, Jianlin Jiang, Su Zhang, Yibing Lv, Yuzhen Guo. ADMM-type methods for generalized multi-facility Weber problem. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020171
[15]

Ripeng Huang, Shaojian Qu, Xiaoguang Yang, Zhimin Liu. Multi-stage distributionally robust optimization with risk aversion. Journal of Industrial & Management Optimization, 2021, 17 (1) : 233-259. doi: 10.3934/jimo.2019109
[16]

Hongguang Ma, Xiang Li. Multi-period hazardous waste collection planning with consideration of risk stability. Journal of Industrial & Management Optimization, 2021, 17 (1) : 393-408. doi: 10.3934/jimo.2019117
[17]

Zongyuan Li, Weinan Wang. Norm inflation for the Boussinesq system. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020353
[18]

Zhenzhen Wang, Tianshou Zhou. Asymptotic behaviors and stochastic traveling waves in stochastic Fisher-KPP equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020323
[19]

A. M. Elaiw, N. H. AlShamrani, A. Abdel-Aty, H. Dutta. Stability analysis of a general HIV dynamics model with multi-stages of infected cells and two routes of infection. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020441
[20]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264

 Impact Factor: 0.263

Tools

Article outline

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences