# American Institute of Mathematical Sciences

September  2018, 8(3&4): 557-582. doi: 10.3934/mcrf.2018023

## Numerical study of polynomial feedback laws for a bilinear control problem

 1 Institute of Mathematics and Scientific Computing, University of Graz, Heinrichstrasse 36, 8010 Graz, Austria 2 RICAM Institute, Austrian Academy of Sciences, Altenbergerstrasse 69, 4040 Linz, Austria

* Corresponding author: Karl Kunisch

Received  September 2017 Revised  July 2018 Published  September 2018

An infinite-dimensional bilinear optimal control problem with infinite-time horizon is considered. The associated value function can be expanded in a Taylor series around the equilibrium, the Taylor series involving multilinear forms which are uniquely characterized by generalized Lyapunov equations. A numerical method for solving these equations is proposed. It is based on a generalization of the balanced truncation model reduction method and some techniques of tensor calculus, in order to attenuate the curse of dimensionality. Polynomial feedback laws are derived from the Taylor expansion and are numerically investigated for a control problem of the Fokker-Planck equation. Their efficiency is demonstrated for initial values which are sufficiently close to the equilibrium.

Citation: Tobias Breiten, Karl Kunisch, Laurent Pfeiffer. Numerical study of polynomial feedback laws for a bilinear control problem. Mathematical Control & Related Fields, 2018, 8 (3&4) : 557-582. doi: 10.3934/mcrf.2018023
##### References:

show all references

##### References:
1D Fokker-Planck equation
Comparison of the original and reduced models, for $n = 100$, $r = 25$, and $\beta = 10^{-4}$
Comparison of the original and reduced models, for $n = 100$, $r = 25$, and $\beta = 10^{-4}$
Comparison of the reduced models with $r = 21$ and $r = 9$, derived from a finer discretization (with $n = 1000$), with the setup of Figure 3
Convergence of the control laws for $\beta = 10^{-4}, n = 1000$ and $r = 9.$
Convergence of the control laws for $\beta = 10^{-4}, n = 1000$ and $r = 9.$
Initial condition and controls for the test case 2
Initial condition and controls for the test case 3
2D Fokker-Planck equation
Control shape functions α1 and α2
Singular value decay for n = 2500
Initial condition and controls for the test case 4
Initial condition and controls for the test case 5
Convergence results for the test case 1
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.038 0.038 0.038 0.038 0.038 0.038 1e$^{-4}$ 0.034 0.033 0.033 0.033 0.033 0.032 1e$^{-5}$ 0.037 0.031 0.031 0.031 0.031 0.030 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 0.228 0.026 0.024 0.024 0.024 1e$^{-4}$ 4.26 1.19 0.82 0.61 0.61 1e$^{-5}$ 29.8 10.3 7.91 4.70 4.05 (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.038 0.038 0.038 0.038 0.038 0.038 1e$^{-4}$ 0.034 0.033 0.033 0.033 0.033 0.032 1e$^{-5}$ 0.037 0.031 0.031 0.031 0.031 0.030 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 0.228 0.026 0.024 0.024 0.024 1e$^{-4}$ 4.26 1.19 0.82 0.61 0.61 1e$^{-5}$ 29.8 10.3 7.91 4.70 4.05 (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
Convergence results for the test case 2
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.156 0.155 0.155 0.155 0.155 0.154 5e$^{-4}$ 0.147 0.145 0.145 0.145 0.145 0.144 1e$^{-4}$ 0.138 0.122 0.120 0.120 0.120 0.119 5e$^{-5}$ 0.190 0.114 0.111 0.112 0.111 0.110 1e$^{-5}$ 0.205 0.194 0.104 0.111 0.113 0.095 (A) Cost of the controls up. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 1.149 0.169 0.119 0.034 0.031 5e$^{-4}$ 2.583 0.737 0.171 0.336 0.219 1e$^{-4}$ 18.50 7.02 3.16 4.01 1.52 5e$^{-5}$ 46.87 13.18 8.40 8.17 2.65 1e$^{-5}$ 90.5 78.0 39.0 42.6 34.3 (B) L2-distance between the controls up and the optimal control uopt.
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.156 0.155 0.155 0.155 0.155 0.154 5e$^{-4}$ 0.147 0.145 0.145 0.145 0.145 0.144 1e$^{-4}$ 0.138 0.122 0.120 0.120 0.120 0.119 5e$^{-5}$ 0.190 0.114 0.111 0.112 0.111 0.110 1e$^{-5}$ 0.205 0.194 0.104 0.111 0.113 0.095 (A) Cost of the controls up. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 1.149 0.169 0.119 0.034 0.031 5e$^{-4}$ 2.583 0.737 0.171 0.336 0.219 1e$^{-4}$ 18.50 7.02 3.16 4.01 1.52 5e$^{-5}$ 46.87 13.18 8.40 8.17 2.65 1e$^{-5}$ 90.5 78.0 39.0 42.6 34.3 (B) L2-distance between the controls up and the optimal control uopt.
Convergence results for the test case 3
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.525 0.511 0.511 0.512 0.510 0.507 5e$^{-4}$ 0.451 0.417 0.431 0.459 0.446 0.408 1e$^{-4}$ 0.381 0.368 2.689 $\infty$ $\infty$ 0.246 5e$^{-5}$ 0.381 0.432 $\infty$ $\infty$ $\infty$ 0.206 1e$^{-5}$ 0.365 $\infty$ $\infty$ $\infty$ $\infty$ 0.147 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 4.88 1.50 1.77 2.31 1.52 5e$^{-4}$ 11.26 5.03 7.11 11.89 11.99 1e$^{-4}$ 46.34 35.36 57.08 $\infty$ $\infty$ 5e$^{-5}$ 74.79 60.86 $\infty$ $\infty$ $\infty$ 1e$^{-5}$ 172.3 $\infty$ $\infty$ $\infty$ $\infty$ (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_6)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.525 0.511 0.511 0.512 0.510 0.507 5e$^{-4}$ 0.451 0.417 0.431 0.459 0.446 0.408 1e$^{-4}$ 0.381 0.368 2.689 $\infty$ $\infty$ 0.246 5e$^{-5}$ 0.381 0.432 $\infty$ $\infty$ $\infty$ 0.206 1e$^{-5}$ 0.365 $\infty$ $\infty$ $\infty$ $\infty$ 0.147 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ $p=6$ 1e$^{-3}$ 4.88 1.50 1.77 2.31 1.52 5e$^{-4}$ 11.26 5.03 7.11 11.89 11.99 1e$^{-4}$ 46.34 35.36 57.08 $\infty$ $\infty$ 5e$^{-5}$ 74.79 60.86 $\infty$ $\infty$ $\infty$ 1e$^{-5}$ 172.3 $\infty$ $\infty$ $\infty$ $\infty$ (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
Convergence results for the test case 4
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.247 0.235 0.234 0.234 0.232 5e$^{-4}$ 0.232 0.207 0.205 0.205 0.203 1e$^{-4}$ 0.252 0.180 0.174 0.174 0.171 5e$^{-5}$ 0.279 0.179 0.168 0.168 0.165 1e$^{-5}$ 0.524 0.182 20.696 0.164 0.158 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ 1e$^{-3}$ 3.53 0.80 0.19 0.14 5e$^{-4}$ 6.73 1.42 0.37 0.24 1e$^{-4}$ 27.40 5.78 1.83 1.24 5e$^{-5}$ 52.50 11.06 3.69 2.40 1e$^{-5}$ 257.01 63.97 84.31 10.61 (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_{\text{opt}})$ 1e$^{-3}$ 0.247 0.235 0.234 0.234 0.232 5e$^{-4}$ 0.232 0.207 0.205 0.205 0.203 1e$^{-4}$ 0.252 0.180 0.174 0.174 0.171 5e$^{-5}$ 0.279 0.179 0.168 0.168 0.165 1e$^{-5}$ 0.524 0.182 20.696 0.164 0.158 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ 1e$^{-3}$ 3.53 0.80 0.19 0.14 5e$^{-4}$ 6.73 1.42 0.37 0.24 1e$^{-4}$ 27.40 5.78 1.83 1.24 5e$^{-5}$ 52.50 11.06 3.69 2.40 1e$^{-5}$ 257.01 63.97 84.31 10.61 (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
Convergence results for the test case 5
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_{\text{opt}})$ 1e$^{-1}$ 7.58 7.57 7.57 7.57 7.52 5e$^{-2}$ 6.41 6.39 6.40 6.39 6.35 1e$^{-2}$ 3.70 3.34 3.09 3.32 3.00 5e$^{-3}$ 3.07 2.68 2.28 2.96 2.05 1e$^{-3}$ 2.45 2.41 $\infty$ $\infty$ 0.93 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ 1e$^{-1}$ 0.70 0.61 0.62 0.60 5e$^{-2}$ 1.10 0.69 0.80 0.63 1e$^{-2}$ 13.02 11.10 4.08 9.01 5e$^{-3}$ 21.59 19.80 9.66 20.06 1e$^{-3}$ 47.34 55.69 $\infty$ $\infty$ (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
 $\beta$ $J(u_2)$ $J(u_3)$ $J(u_4)$ $J(u_5)$ $J(u_{\text{opt}})$ 1e$^{-1}$ 7.58 7.57 7.57 7.57 7.52 5e$^{-2}$ 6.41 6.39 6.40 6.39 6.35 1e$^{-2}$ 3.70 3.34 3.09 3.32 3.00 5e$^{-3}$ 3.07 2.68 2.28 2.96 2.05 1e$^{-3}$ 2.45 2.41 $\infty$ $\infty$ 0.93 (A) Cost of the controls $u_p$. $\beta$ $\| u_p-u_{\text{opt}} \|_{L^2(0, T)}$ $p=2$ $p=3$ $p=4$ $p=5$ 1e$^{-1}$ 0.70 0.61 0.62 0.60 5e$^{-2}$ 1.10 0.69 0.80 0.63 1e$^{-2}$ 13.02 11.10 4.08 9.01 5e$^{-3}$ 21.59 19.80 9.66 20.06 1e$^{-3}$ 47.34 55.69 $\infty$ $\infty$ (B) $L^2$-distance between the controls $u_p$ and the optimal control $u_{\text{opt}}$.
 [1] Sergey Rashkovskiy. Hamilton-Jacobi theory for Hamiltonian and non-Hamiltonian systems. Journal of Geometric Mechanics, 2020, 12 (4) : 563-583. doi: 10.3934/jgm.2020024 [2] Vo Van Au, Hossein Jafari, Zakia Hammouch, Nguyen Huy Tuan. On a final value problem for a nonlinear fractional pseudo-parabolic equation. Electronic Research Archive, 2021, 29 (1) : 1709-1734. doi: 10.3934/era.2020088 [3] Peter Frolkovič, Karol Mikula, Jooyoung Hahn, Dirk Martin, Branislav Basara. Flux balanced approximation with least-squares gradient for diffusion equation on polyhedral mesh. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 865-879. doi: 10.3934/dcdss.2020350 [4] Christian Clason, Vu Huu Nhu, Arnd Rösch. Optimal control of a non-smooth quasilinear elliptic equation. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020052 [5] Olivier Ley, Erwin Topp, Miguel Yangari. Some results for the large time behavior of Hamilton-Jacobi equations with Caputo time derivative. Discrete & Continuous Dynamical Systems - A, 2021  doi: 10.3934/dcds.2021007 [6] Yi Zhou, Jianli Liu. The initial-boundary value problem on a strip for the equation of time-like extremal surfaces. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 381-397. doi: 10.3934/dcds.2009.23.381 [7] Leilei Wei, Yinnian He. A fully discrete local discontinuous Galerkin method with the generalized numerical flux to solve the tempered fractional reaction-diffusion equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020319 [8] Lihong Zhang, Wenwen Hou, Bashir Ahmad, Guotao Wang. Radial symmetry for logarithmic Choquard equation involving a generalized tempered fractional $p$-Laplacian. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020445 [9] Marc Homs-Dones. A generalization of the Babbage functional equation. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 899-919. doi: 10.3934/dcds.2020303 [10] Larissa Fardigola, Kateryna Khalina. Controllability problems for the heat equation on a half-axis with a bounded control in the Neumann boundary condition. Mathematical Control & Related Fields, 2021, 11 (1) : 211-236. doi: 10.3934/mcrf.2020034 [11] Xiaorui Wang, Genqi Xu, Hao Chen. Uniform stabilization of 1-D Schrödinger equation with internal difference-type control. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021022 [12] Julian Tugaut. Captivity of the solution to the granular media equation. Kinetic & Related Models, , () : -. doi: 10.3934/krm.2021002 [13] Bilel Elbetch, Tounsia Benzekri, Daniel Massart, Tewfik Sari. The multi-patch logistic equation. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021025 [14] Yueh-Cheng Kuo, Huey-Er Lin, Shih-Feng Shieh. Asymptotic dynamics of hermitian Riccati difference equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020365 [15] Ilyasse Lamrani, Imad El Harraki, Ali Boutoulout, Fatima-Zahrae El Alaoui. Feedback stabilization of bilinear coupled hyperbolic systems. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020434 [16] Peter Poláčik, Pavol Quittner. Entire and ancient solutions of a supercritical semilinear heat equation. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 413-438. doi: 10.3934/dcds.2020136 [17] Jianhua Huang, Yanbin Tang, Ming Wang. Singular support of the global attractor for a damped BBM equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020345 [18] Stefano Bianchini, Paolo Bonicatto. Forward untangling and applications to the uniqueness problem for the continuity equation. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020384 [19] Anh Tuan Duong, Phuong Le, Nhu Thang Nguyen. Symmetry and nonexistence results for a fractional Choquard equation with weights. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 489-505. doi: 10.3934/dcds.2020265 [20] Maicon Sônego. Stable transition layers in an unbalanced bistable equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020370

2019 Impact Factor: 0.857