# American Institute of Mathematical Sciences

January  2021, 26(1): 299-336. doi: 10.3934/dcdsb.2020331

## Computing complete Lyapunov functions for discrete-time dynamical systems

 1 Department of Mathematics, University of Sussex, Falmer BN1 9QH, United Kingdom 2 Faculty of Physical Sciences, University of Iceland, 107 Reykjavik, Iceland

Received  May 2020 Revised  October 2020 Published  January 2021 Early access  November 2020

Fund Project: The research in this paper was supported by the Icelandic Research Fund (Rannís) grant number 163074-052, Complete Lyapunov functions: Efficient numerical computation

A complete Lyapunov function characterizes the behaviour of a general discrete-time dynamical system. In particular, it divides the state space into the chain-recurrent set where the complete Lyapunov function is constant along trajectories and the part where the flow is gradient-like and the complete Lyapunov function is strictly decreasing along solutions. Moreover, the level sets of a complete Lyapunov function provide information about attractors, repellers, and basins of attraction.

We propose two novel classes of methods to compute complete Lyapunov functions for a general discrete-time dynamical system given by an iteration. The first class of methods computes a complete Lyapunov function by approximating the solution of an ill-posed equation for its discrete orbital derivative using meshfree collocation. The second class of methods computes a complete Lyapunov function as solution of a minimization problem in a reproducing kernel Hilbert space. We apply both classes of methods to several examples.

Citation: Peter Giesl, Zachary Langhorne, Carlos Argáez, Sigurdur Hafstein. Computing complete Lyapunov functions for discrete-time dynamical systems. Discrete & Continuous Dynamical Systems - B, 2021, 26 (1) : 299-336. doi: 10.3934/dcdsb.2020331
##### References:

show all references

##### References:
Example (24) with solving $\Delta v(x,y) = -1$. Chain-recurrent set (top) approximated by the set $\{(x,y)\, \mid\, \Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (middle) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$. $\Delta v$ is approximately zero on the chain-recurrent set (origin) and negative everywhere else. Bottom: Constructed complete Lyapunov function $v(x,y)$, which has a minimum at the origin
Example (24) with equality and inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ (middle). Again, the orbital derivative $\Delta v$ is correctly approximated being zero on the chain-recurrent set (origin) and negative everywhere else. Bottom: Constructed complete Lyapunov function $v(x,y)$, which has a minimum at the origin. The point with equality constraint was $(0.5,0)$
Example (24) with inequality constraints. Chain recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ (middle). $\Delta v$ is approximately zero on the chain-recurrent set (origin) and negative everywhere else. Bottom: The constructed complete Lyapunov function $v(x,y)$, which has a minimum at the origin
Example (25) with solving $\Delta v(x,y) = -1$. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. The approximated chain-recurrent set includes the equilibria at the origin and $(\pm 1,0)$, but is much larger, in particular around the origin. Bottom: Constructed complete Lyapunov function $v(x,y)$, which has a saddle point at the origin and a local maximum at the unstable equilibria $(\pm 1,0)$
Example (25) with equality and inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. $\Delta v$ is approximately zero on the chain-recurrent set, consisting of three equilibria at the origin and $(\pm 1,0)$, and negative everywhere else. The approximation of the chain-recurrent set (the equilibria) is much better than when solving the equation $\Delta v(x,y) = -1$. Bottom: Constructed complete Lyapunov function $v(x,y)$, which has a saddle point at the origin and local maxima at the unstable equilibria $(\pm 1,0)$. Note that they have different levels, which is due to the extra point with equality constraint at $(0.5,0)$, resulting in an unsymmetric approximation
Example (25) with inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. $\Delta v$ is approximately zero on the chain-recurrent set, consisting of three equilibria at the origin and $(\pm 1,0)$, and negative everywhere else. The approximation of the chain-recurrent set (the equilibria) is much better than when solving the equation $\Delta v(x,y) = -1$. Bottom: Constructed complete Lyapunov function $v(x,y)$, which has a saddle point at the origin and local maxima at the unstable equilibria $(\pm 1,0)$
Example (26) with solving $\Delta v(x,y) = -1$. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$. The approximated chain-recurrent set does not resemble the Hénon attractor very well, neither using the orbital derivative nor as the local minimum of the constructed function
Example (26) with equality and inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. The characteristic shape of the Hénon attractor is clearly visible. Bottom: Constructed complete Lyapunov function $v(x,y)$ with a local minimum at the Hénon attractor. The point with equality constraint was $(0.5,0)$
Example (26) with inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. The characteristic shape of the Hénon attractor is clearly visible. Bottom: Constructed complete Lyapunov function $v(x,y)$ with a local minimum at the Hénon attractor
Example (27) with solving $\Delta v(x,y) = -1$. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$. The approximated chain-recurrent set shows the Hénon repeller better than the Hénon attractor in the previous example, but still not very clearly. It is not clearly visible as local maximum of the constructed function either
Example (27) with equality and inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$, showing the Hénon repeller as a local maximum. The repeller is clearly visible in all figures. The point with equality constraint was $(0.5,0)$
Example (27) with inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$, showing the Hénon repeller as a local maximum. The repeller is clearly visible in all figures
Example (28) with solving $\Delta v(x,y) = -1$. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$. The approximated chain-recurrent set shows the attractor relatively well in the orbital derivative, but not very clearly as local minimum of the constructed function
Example (28) with equality and inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$, showing the attractor as a local minimum. The attractor is clearer than in the previous method, both using the orbital derivative and as local minimum of the constructed function. The point with equality constraint was $(0.5,0)$, where the orbital derivative is fixed at $-1$
Example (28) with inequality constraints. Chain-recurrent set (top) approximated by the set $\{(x,y)\,\mid\,\Delta v(x,y)\ge \gamma\}$, see Table 2, and the orbital derivative (second) $\Delta v(x,y)$ of the constructed complete Lyapunov function $v$ over the chain-recurrent set. The third figure shows the orbital derivative in a larger set. Bottom: Constructed complete Lyapunov function $v(x,y)$, showing the attractor as a local minimum. The attractor is clearer than in the first method, both using the orbital derivative and as local minimum of the constructed function
Example (29) with solving $\Delta v(x,y,z) = -1$. Top: Chain-recurrent set approximated by the set $\{(x,y,z)\,\mid\,\Delta v(x,y,z)\ge \gamma\}$, see Table 2. The other figures show projections of this set: projections to the $xy-$ (second), $yz-$ (third) and $xz-$plane (bottom)
Example (29) with equality-inequality constrains. Top: Chain-recurrent set approximated by the set $\{(x,y,z)\,\mid\,\Delta v(x,y,z)\ge \gamma\}$, see Table 2. The other figures show projections of this set: projections to the $xy-$ (second), $yz-$ (third) and $xz-$plane (bottom). The figures are not as good as with the previous method. The point with equality constraint is $(0.4,0.4,0)$
Example (29) with inequality constrains. Top: Chain-recurrent set approximated by the set $\{(x,y,z)\,\mid\,\Delta v(x,y,z)\ge \gamma\}$, see Table 2. The other figures show projections of this set: projections to the $xy-$ (second), $yz-$ (third) and $xz-$plane (bottom)
Collocation points $X$ for the examples. We have used $N$ collocation points in a hexagonal grid with parameter $\alpha_{\text{Hexa-basis}}$ within a rectangle $(x,y)\in [x_{\rm min},x_{\rm max}]\times [y_{\rm min},y_{\rm max}]$ or $(x,y,z)\in [x_{\rm min},x_{\rm max}]\times [y_{\rm min},y_{\rm max}]\times [z_{\rm min},z_{\rm max}]$ for the three-dimensional example (29). The number of evaluation points is also displayed
 Example $N$ $\alpha_{\text{Hexa-basis}}$ #-evaluation $x_{\rm min}$ $x_{\rm max}$ $y_{\rm min}$ $y_{\rm max}$ $z_{\rm min}$ $z_{\rm max}$ (24) $3,584$ $0.072$ 1,779,556 $-2$ $2$ $-2$ $2$ (25) $10,108$ $0.03$ 2,003,001 $-2$ $2$ $-1$ $1$ (26) $1,440$ $0.05$ 1,334,000 $-1.5$ $1.5$ $-0.5$ $0.5$ (27) $5,520$ $0.025$ 1,334,000 $-1.5$ $1.5$ $-0.5$ $0.5$ (28) $2,900$ $0.08$ 1,779,556 $-2$ $2$ $-2$ $2$ (29) $5,301$ $0.07$ 1,030,301 $-0.2$ $0.9$ $-0.2$ $0.9$ $-0.2$ $0.9$
 Example $N$ $\alpha_{\text{Hexa-basis}}$ #-evaluation $x_{\rm min}$ $x_{\rm max}$ $y_{\rm min}$ $y_{\rm max}$ $z_{\rm min}$ $z_{\rm max}$ (24) $3,584$ $0.072$ 1,779,556 $-2$ $2$ $-2$ $2$ (25) $10,108$ $0.03$ 2,003,001 $-2$ $2$ $-1$ $1$ (26) $1,440$ $0.05$ 1,334,000 $-1.5$ $1.5$ $-0.5$ $0.5$ (27) $5,520$ $0.025$ 1,334,000 $-1.5$ $1.5$ $-0.5$ $0.5$ (28) $2,900$ $0.08$ 1,779,556 $-2$ $2$ $-2$ $2$ (29) $5,301$ $0.07$ 1,030,301 $-0.2$ $0.9$ $-0.2$ $0.9$ $-0.2$ $0.9$
The value of the parameter $\gamma\le 0$, close to $0$, for all examples. The chain-recurrent set is approximated by the set $\left(\Delta v \right)^{-1}([\gamma,\infty))$
 $\gamma$ for each method System $\Delta v(x)=-1$ equality-inequality inequality (24) $-0.1$ $-10^{-5}$ $0$ (25) $-0.2$ $-10^{-5}$ $-10^{-4}$ (26) $-0.1$ $0$ $-10^{-2}$ (27) $-0.1$ $0$ $0$ (28) $-0.1$ $0$ $0$ (29) $-0.1$ $0$ $0$
 $\gamma$ for each method System $\Delta v(x)=-1$ equality-inequality inequality (24) $-0.1$ $-10^{-5}$ $0$ (25) $-0.2$ $-10^{-5}$ $-10^{-4}$ (26) $-0.1$ $0$ $-10^{-2}$ (27) $-0.1$ $0$ $0$ (28) $-0.1$ $0$ $0$ (29) $-0.1$ $0$ $0$
 [1] Peter Giesl, Najla Mohammed. Verification estimates for the construction of Lyapunov functions using meshfree collocation. Discrete & Continuous Dynamical Systems - B, 2019, 24 (9) : 4955-4981. doi: 10.3934/dcdsb.2019040 [2] Peter Giesl. Construction of a finite-time Lyapunov function by meshless collocation. Discrete & Continuous Dynamical Systems - B, 2012, 17 (7) : 2387-2412. doi: 10.3934/dcdsb.2012.17.2387 [3] Shaohong Fang, Jing Huang, Jinying Ma. Stabilization of a discrete-time system via nonlinear impulsive control. Discrete & Continuous Dynamical Systems - S, 2020, 13 (6) : 1803-1811. doi: 10.3934/dcdss.2020106 [4] Martino Bardi, Shigeaki Koike, Pierpaolo Soravia. Pursuit-evasion games with state constraints: dynamic programming and discrete-time approximations. Discrete & Continuous Dynamical Systems, 2000, 6 (2) : 361-380. doi: 10.3934/dcds.2000.6.361 [5] Yadong Shu, Bo Li. Linear-quadratic optimal control for discrete-time stochastic descriptor systems. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021034 [6] Hongyan Yan, Yun Sun, Yuanguo Zhu. A linear-quadratic control problem of uncertain discrete-time switched systems. Journal of Industrial & Management Optimization, 2017, 13 (1) : 267-282. doi: 10.3934/jimo.2016016 [7] Elena K. Kostousova. On polyhedral estimates for trajectory tubes of dynamical discrete-time systems with multiplicative uncertainty. Conference Publications, 2011, 2011 (Special) : 864-873. doi: 10.3934/proc.2011.2011.864 [8] Byungik Kahng, Miguel Mendes. The characterization of maximal invariant sets of non-linear discrete-time control dynamical systems. Conference Publications, 2013, 2013 (special) : 393-406. doi: 10.3934/proc.2013.2013.393 [9] Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete & Continuous Dynamical Systems, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153 [10] Elena K. Kostousova. On control synthesis for uncertain dynamical discrete-time systems through polyhedral techniques. Conference Publications, 2015, 2015 (special) : 723-732. doi: 10.3934/proc.2015.0723 [11] Yulin Zhao. On the monotonicity of the period function of a quadratic system. Discrete & Continuous Dynamical Systems, 2005, 13 (3) : 795-810. doi: 10.3934/dcds.2005.13.795 [12] Jaydeep Swarnakar. Discrete-time realization of fractional-order proportional integral controller for a class of fractional-order system. Numerical Algebra, Control & Optimization, 2021  doi: 10.3934/naco.2021007 [13] Robert Baier, Lars Grüne, Sigurđur Freyr Hafstein. Linear programming based Lyapunov function computation for differential inclusions. Discrete & Continuous Dynamical Systems - B, 2012, 17 (1) : 33-56. doi: 10.3934/dcdsb.2012.17.33 [14] Paul L. Salceanu, H. L. Smith. Lyapunov exponents and persistence in discrete dynamical systems. Discrete & Continuous Dynamical Systems - B, 2009, 12 (1) : 187-203. doi: 10.3934/dcdsb.2009.12.187 [15] Simone Fiori. Auto-regressive moving-average discrete-time dynamical systems and autocorrelation functions on real-valued Riemannian matrix manifolds. Discrete & Continuous Dynamical Systems - B, 2014, 19 (9) : 2785-2808. doi: 10.3934/dcdsb.2014.19.2785 [16] Angelica Pachon, Federico Polito, Costantino Ricciuti. On discrete-time semi-Markov processes. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1499-1529. doi: 10.3934/dcdsb.2020170 [17] Paul L. Salceanu. Robust uniform persistence in discrete and continuous dynamical systems using Lyapunov exponents. Mathematical Biosciences & Engineering, 2011, 8 (3) : 807-825. doi: 10.3934/mbe.2011.8.807 [18] Eduardo Liz. A new flexible discrete-time model for stable populations. Discrete & Continuous Dynamical Systems - B, 2018, 23 (6) : 2487-2498. doi: 10.3934/dcdsb.2018066 [19] Ming Chen, Hao Wang. Dynamics of a discrete-time stoichiometric optimal foraging model. Discrete & Continuous Dynamical Systems - B, 2021, 26 (1) : 107-120. doi: 10.3934/dcdsb.2020264 [20] Lih-Ing W. Roeger, Razvan Gelca. Dynamically consistent discrete-time Lotka-Volterra competition models. Conference Publications, 2009, 2009 (Special) : 650-658. doi: 10.3934/proc.2009.2009.650

2020 Impact Factor: 1.327