Understanding intelligence requires understanding the complexity emergent from dynamics. From the Hodgkin-Huxley model of single-neuron behavior to Hopfield-Hinton high-dimensional neural networks, and now to transformers and reservoir computing, intelligence arises from the interplay of complex dynamical systems. Collective computation, attractor dynamics, and emergent phenomena demonstrate that system-level behaviors transcend individual components. Advances in artificial intelligence reveal that high-dimensional parameter spaces, nonlinear interactions, and memory effects shape capabilities interpretable through dynamical systems theory. This emerging frontier, which we term Intellidynamics, unites mathematical modeling, computational architectures, and experimental insight to illuminate how intelligence arises, adapts, and interacts with the principles of complex systems, enabling approaches that leverage mutual benefits between modern AI and complex dynamics.
| Citation: |
| [1] |
A. L. Hodgkin and A. F. Huxley, A quantitative description of membrane current and its application to conduction and excitation in nerve, Journal of Physiology, 117 (1952), 500-544.
doi: 10.1113/jphysiol.1952.sp004764.
|
| [2] |
P. W. Anderson, More is different, Science, 177 (1972), 393-396.
doi: 10.1126/science.177.4047.393.
|
| [3] |
C. van Vreeswijk and H. Sompolinsky, Chaos in neuronal networks with balanced excitatory and inhibitory activity, Science, 274 (1996), 1724-1726.
doi: 10.1126/science.274.5293.1724.
|
| [4] |
D. J. Watts and S. H. Strogatz, Collective dynamics of 'small-world' networks, Nature, 393 (1998), 440-442.
doi: 10.1038/30918.
|
| [5] |
E. M. Izhikevich, Dynamical Systems in Neuroscience, MIT Press, Cambridge, 2007.
|
| [6] |
J. Halatek and E. Frey, Rethinking pattern formation in reaction–diffusion systems, Nature Physics, 14 (2018), 507-514.
doi: 10.1038/s41567-017-0040-5.
|
| [7] |
L. Yang, J. Zhang, S. Zhou and W. Lin, Advancements in mathematical approaches for deciphering deep brain stimulation: A systematic review, CSIAM Transactions on Life Sciences, 1 (2025), 93-133.
doi: 10.4208/csiam-ls.SO-2024-0004.
|
| [8] |
S. Amari, Dynamics of pattern formation in lateral-inhibition type neural fields, Biological Cybernetics, 27 (1977), 77-87.
doi: 10.1007/BF00337259.
|
| [9] |
S. Amari, Natural gradient works efficiently in learning, Neural Computation, 10 (1998), 251-276.
doi: 10.1162/089976698300017746.
|
| [10] |
J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proceedings of the National Academy of Sciences, 79 (1982), 2554-2558.
doi: 10.1073/pnas.79.8.2554.
|
| [11] |
G. E. Hinton, Learning multiple layers of representation, Trends in Cognitive Sciences, 11 (2007), 428-434.
doi: 10.1016/j.tics.2007.09.004.
|
| [12] |
The Nobel Prize in Physics 2024, NobelPrize.org–awarded jointly to John J. Hopfield and Geoffrey Hinton, Royal Swedish Academy of Sciences.
|
| [13] |
A. Krizhevsky, I. Sutskever and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems, 25 (2012), 1097-1105.
|
| [14] |
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser and I. Polosukhin, Attention is all you need, Advances in Neural Information Processing Systems, 30 (2017), 5998-6008.
|
| [15] |
M. Yan, C. Huang, P. Bienstman, P. Tino, W. Lin and J. Sun, Emerging opportunities and challenges for the future of reservoir computing, Nature Communications, 15 (2024), 2056.
doi: 10.1038/s41467-024-45187-1.
|
| [16] |
W. Lin and G. Chen, Large memory capacity in chaotic artificial neural networks: A view of the anti-integrable limit, IEEE Transactions on Neural Networks, 20 (2009), 1340-1351.
doi: 10.1109/TNN.2009.2024148.
|
| [17] |
X. Li, Q. Zhu, C. Zhao, X. Qian, X. Zhang, X. Duan and W. Lin, Tipping point detection using reservoir computing, Research, 6 (2023), 0174.
doi: 10.34133/research.0174.
|
| [18] |
L. O. Chua, Memristors on 'edge of chaos', Nature Reviews Electrical Engineering, 1 (2024), 559-560.
doi: 10.1038/s44287-024-00098-7.
|
| [19] |
W. E, A proposal on machine learning via dynamical systems, Communications in Mathematics and Statistics, 5 (2017), 1-11.
doi: 10.1007/s40304-017-0103-z.
|
| [20] |
R. T. Chen, Y. Rubanova, J. Bettencourt and D. K. Duvenaud, Neural ordinary differential equations, Advances in Neural Information Processing Systems, 31 (2018), 6572-6583.
|
| [21] |
D. Ruiz-Balet and E. Zuazua, Neural ODE control for classification, approximation, and transport, SIAM Review, 65 (2023), 735-773.
doi: 10.1137/21M1411433.
|
| [22] |
Q. Zhu, Y. Guo and W. Lin, Neural delay differential equations, in Proceedings of the 9th International Conference on Learning Representations (ICLR 2021), 2021.
|
| [23] |
B. Zhao, X. Zhang, Y. Dong, X. Lu, W. Lin and Q. Zhu, Delay flow matching, in Proceedings of the 14th International Conference on Learning Representations (ICLR 2026), 2026.
|
| [24] |
L. Berti, F. Giorgi and G. Kasneci, Emergent abilities in large language models: A survey, arXiv: 2503.05788, 2025.
|
| [25] |
B. Geshkovski, C. Letrouit, Y. Polyanskiy and P. Rigollet, A mathematical perspective on transformers, Bulletin of the American Mathematical Society, 62 (2025), 427-479.
doi: 10.1090/bull/1863.
|