
-
Previous Article
Strict dissipativity for discrete time discounted optimal control problems
- MCRF Home
- This Issue
-
Next Article
Approximate controllability of nonlinear parabolic PDEs in arbitrary space dimension
Strict dissipativity analysis for classes of optimal control problems involving probability density functions
1. | Chair of Serious Games, University of Bayreuth, 95440 Bayreuth, Germany |
2. | Chair of Applied Mathematics, University of Bayreuth, 95440 Bayreuth, Germany |
Motivated by the stability and performance analysis of model predictive control schemes, we investigate strict dissipativity for a class of optimal control problems involving probability density functions. The dynamics are governed by a Fokker-Planck partial differential equation. However, for the particular classes under investigation involving linear dynamics, linear feedback laws, and Gaussian probability density functions, we are able to significantly simplify these dynamics. This enables us to perform an in-depth analysis of strict dissipativity for different cost functions.
References:
[1] |
Y. Achdou, F. Camilli and I. Capuzzo-Dolcetta,
Mean field games: Numerical methods for the planning problem, SIAM J. Control Optim., 50 (2012), 77-109.
doi: 10.1137/100790069. |
[2] |
D. Angeli, R. Amrit and J. B. Rawlings,
On average performance and stability of economic model predictive control, IEEE Trans. Autom. Control, 57 (2012), 1615-1626.
doi: 10.1109/TAC.2011.2179349. |
[3] |
M. Annunziato and A. Borzì,
Optimal control of probability density functions of stochastic processes, Math. Model. Anal., 15 (2010), 393-407.
doi: 10.3846/1392-6292.2010.15.393-407. |
[4] |
M. Annunziato and A. Borzì,
A Fokker-Planck control framework for multidimensional stochastic processes, J. Comput. Appl. Math., 237 (2013), 487-507.
doi: 10.1016/j.cam.2012.06.019. |
[5] |
J.-D. Benamou and G. Carlier,
Augmented Lagrangian methods for transport optimization, mean field games and degenerate elliptic equations, J. Optim. Theory Appl., 167 (2015), 1-26.
doi: 10.1007/s10957-015-0725-9. |
[6] |
M. Bongini, M. Fornasier, F. Rossi and F. Solombrino,
Mean-field Pontryagin maximum principle, J. Optim. Theory Appl., 175 (2017), 1-38.
doi: 10.1007/s10957-017-1149-5. |
[7] |
T. Breiten, K. Kunisch and L. Pfeiffer,
Control strategies for the Fokker-Planck equation, ESAIM: COCV, 24 (2018), 741-763.
doi: 10.1051/cocv/2017046. |
[8] |
T. Breiten and L. Pfeiffer,
On the turnpike property and the receding-horizon method for linear-quadratic optimal control problems, SIAM Journal on Control and Optimization, 58 (2020), 1077-1102.
doi: 10.1137/18M1225811. |
[9] |
T. Damm, L. Grüne, M. Stieler and K. Worthmann,
An exponential turnpike theorem for dissipative discrete time optimal control problems, SIAM J. Control Optim., 52 (2014), 1935-1957.
doi: 10.1137/120888934. |
[10] |
M. Diehl, R. Amrit and J. B. Rawlings,
A Lyapunov function for economic optimizing model predictive control, IEEE Trans. Autom. Control, 56 (2011), 703-707.
doi: 10.1109/TAC.2010.2101291. |
[11] |
T. Faulwasser, L. Grüne and M. A. Müller, Economic nonlinear model predictive control, Foundations and Trends® in Systems and Control, 5 (2018), 1–98. Google Scholar |
[12] |
A. Fleig and L. Grüne,
Estimates on the minimal stabilizing horizon length in model predictive control for the Fokker-Planck equation, IFAC-PapersOnLine, 49 (2016), 260-265.
doi: 10.1016/j.ifacol.2016.07.451. |
[13] |
A. Fleig and L. Grüne,
$L^2$-tracking of Gaussian distributions via model predictive control for the Fokker-Planck equation, Vietnam J. Math., 46 (2018), 915-948.
doi: 10.1007/s10013-018-0309-8. |
[14] |
A. Fleig and L. Grüne, On dissipativity of the Fokker-Planck equation for the OrnsteinUhlenbeck process, in IFAC-PapersOnLine, 3rd IFAC Workshop on Control of Systems Governed by Partial Differential Equations CPDE 2019, 52 (2019), 13-18, |
[15] |
C. R. Givens and R. M. Shortt,
A class of wasserstein metrics for probability distributions, Michigan Math. J., 31 (1984), 231-240.
doi: 10.1307/mmj/1029003026. |
[16] |
L. Grüne,
Economic receding horizon control without terminal constraints, Automatica, 49 (2013), 725-734.
doi: 10.1016/j.automatica.2012.12.003. |
[17] |
L. Grüne and R. Guglielmi,
Turnpike properties and strict dissipativity for discrete time linear quadratic optimal control problems, SIAM J. Cont. Optim., 56 (2018), 1282-1302.
doi: 10.1137/17M112350X. |
[18] |
L. Grüne and M. A. Müller,
On the relation between strict dissipativity and the turnpike property, Syst. Contr. Lett., 90 (2016), 45-53.
doi: 10.1016/j.sysconle.2016.01.003. |
[19] |
L. Grüne and J. Pannek, Nonlinear Model Predictive Control, Theory and Algorithms, 2nd edition, Springer, London, 2017.
doi: 10.1007/978-3-319-46024-6. |
[20] |
L. Grüne, M. Schaller and A. Schiela,
Sensitivity analysis of optimal control for a class of parabolic PDEs motivated by model predictive control, SIAM J. Control Optim., 57 (2019), 2753-2774.
doi: 10.1137/18M1223083. |
[21] |
L. Grüne and M. Stieler, Asymptotic stability and transient optimality of economic MPC without terminal conditions, J. Proc. Control, 24 (2014), 1187-1196. Google Scholar |
[22] |
L. Grüne, M. Schaller and A. Schiela,
Exponential sensitivity and turnpike analysis for linear quadratic optimal control of general evolution equations, J. Differ. Equ., 268 (2020), 7311-7341.
doi: 10.1016/j.jde.2019.11.064. |
[23] |
W. Hahn, Stability of Motion, Springer, 1967. |
[24] |
A. Porretta and E. Zuazua,
Long time versus steady state optimal control, SIAM J. Control Optim., 51 (2013), 4242-4273.
doi: 10.1137/130907239. |
[25] |
S. Primak, V. Kontorovich and V. Lyandres, Stochastic Methods and Their Applications to Communications, John Wiley & Sons, Inc., Hoboken, NJ, 2004. |
[26] |
P. E. Protter, Stochastic Integration and Differential Equations, vol. 21 of Stochastic Modelling and Applied Probability, Springer-Verlag, Berlin, 2005.
doi: 10.1007/978-3-662-10061-5. |
[27] |
J. B. Rawlings, D. Bonné, J. B. Jørgensen, A. N. Venkat and S. B. Jørgensen,
Unreachable setpoints in model predictive control, IEEE Transactions on Automatic Control, 53 (2008), 2209-2215.
doi: 10.1109/TAC.2008.928125. |
[28] |
J. B. Rawlings, D. Q. Mayne and M. M. Diehl, Model Predictive Control: Theory and Design, 2nd edition, Nob Hill Publishing, 2017. Google Scholar |
[29] |
H. Risken, The Fokker-Planck Equation, vol. 18 of Springer Series in Synergetics, 2nd edition, Springer-Verlag, Berlin, 1989.
doi: 10.1007/978-3-642-61544-3. |
[30] |
S. Roy, M. Annunziato and A. Borzì,
A Fokker-Planck feedback control-constrained approach for modelling crowd motion, J. Comput. Theor. Transp., 45 (2016), 442-458.
doi: 10.1080/23324309.2016.1189435. |
[31] |
E. Trélat and E. Zuazua,
The turnpike property in finite-dimensional nonlinear optimal control, J. Differential Equations, 258 (2015), 81-114.
doi: 10.1016/j.jde.2014.09.005. |
[32] |
E. Trélat, C. Zhang and E. Zuazua,
Steady-state and periodic exponential turnpike property for optimal control problems in Hilbert spaces, SIAM J. Control Optim., 56 (2018), 1222-1252.
doi: 10.1137/16M1097638. |
[33] |
F. Tröltzsch, Optimal Control of Partial Differential Equations, vol. 112 of Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2010.
doi: 10.1090/gsm/112. |
[34] |
J. C. Willems,
Dissipative dynamical systems. I. General theory, Arch. Rational Mech. Anal., 45 (1972), 321-351.
doi: 10.1007/BF00276493. |
show all references
References:
[1] |
Y. Achdou, F. Camilli and I. Capuzzo-Dolcetta,
Mean field games: Numerical methods for the planning problem, SIAM J. Control Optim., 50 (2012), 77-109.
doi: 10.1137/100790069. |
[2] |
D. Angeli, R. Amrit and J. B. Rawlings,
On average performance and stability of economic model predictive control, IEEE Trans. Autom. Control, 57 (2012), 1615-1626.
doi: 10.1109/TAC.2011.2179349. |
[3] |
M. Annunziato and A. Borzì,
Optimal control of probability density functions of stochastic processes, Math. Model. Anal., 15 (2010), 393-407.
doi: 10.3846/1392-6292.2010.15.393-407. |
[4] |
M. Annunziato and A. Borzì,
A Fokker-Planck control framework for multidimensional stochastic processes, J. Comput. Appl. Math., 237 (2013), 487-507.
doi: 10.1016/j.cam.2012.06.019. |
[5] |
J.-D. Benamou and G. Carlier,
Augmented Lagrangian methods for transport optimization, mean field games and degenerate elliptic equations, J. Optim. Theory Appl., 167 (2015), 1-26.
doi: 10.1007/s10957-015-0725-9. |
[6] |
M. Bongini, M. Fornasier, F. Rossi and F. Solombrino,
Mean-field Pontryagin maximum principle, J. Optim. Theory Appl., 175 (2017), 1-38.
doi: 10.1007/s10957-017-1149-5. |
[7] |
T. Breiten, K. Kunisch and L. Pfeiffer,
Control strategies for the Fokker-Planck equation, ESAIM: COCV, 24 (2018), 741-763.
doi: 10.1051/cocv/2017046. |
[8] |
T. Breiten and L. Pfeiffer,
On the turnpike property and the receding-horizon method for linear-quadratic optimal control problems, SIAM Journal on Control and Optimization, 58 (2020), 1077-1102.
doi: 10.1137/18M1225811. |
[9] |
T. Damm, L. Grüne, M. Stieler and K. Worthmann,
An exponential turnpike theorem for dissipative discrete time optimal control problems, SIAM J. Control Optim., 52 (2014), 1935-1957.
doi: 10.1137/120888934. |
[10] |
M. Diehl, R. Amrit and J. B. Rawlings,
A Lyapunov function for economic optimizing model predictive control, IEEE Trans. Autom. Control, 56 (2011), 703-707.
doi: 10.1109/TAC.2010.2101291. |
[11] |
T. Faulwasser, L. Grüne and M. A. Müller, Economic nonlinear model predictive control, Foundations and Trends® in Systems and Control, 5 (2018), 1–98. Google Scholar |
[12] |
A. Fleig and L. Grüne,
Estimates on the minimal stabilizing horizon length in model predictive control for the Fokker-Planck equation, IFAC-PapersOnLine, 49 (2016), 260-265.
doi: 10.1016/j.ifacol.2016.07.451. |
[13] |
A. Fleig and L. Grüne,
$L^2$-tracking of Gaussian distributions via model predictive control for the Fokker-Planck equation, Vietnam J. Math., 46 (2018), 915-948.
doi: 10.1007/s10013-018-0309-8. |
[14] |
A. Fleig and L. Grüne, On dissipativity of the Fokker-Planck equation for the OrnsteinUhlenbeck process, in IFAC-PapersOnLine, 3rd IFAC Workshop on Control of Systems Governed by Partial Differential Equations CPDE 2019, 52 (2019), 13-18, |
[15] |
C. R. Givens and R. M. Shortt,
A class of wasserstein metrics for probability distributions, Michigan Math. J., 31 (1984), 231-240.
doi: 10.1307/mmj/1029003026. |
[16] |
L. Grüne,
Economic receding horizon control without terminal constraints, Automatica, 49 (2013), 725-734.
doi: 10.1016/j.automatica.2012.12.003. |
[17] |
L. Grüne and R. Guglielmi,
Turnpike properties and strict dissipativity for discrete time linear quadratic optimal control problems, SIAM J. Cont. Optim., 56 (2018), 1282-1302.
doi: 10.1137/17M112350X. |
[18] |
L. Grüne and M. A. Müller,
On the relation between strict dissipativity and the turnpike property, Syst. Contr. Lett., 90 (2016), 45-53.
doi: 10.1016/j.sysconle.2016.01.003. |
[19] |
L. Grüne and J. Pannek, Nonlinear Model Predictive Control, Theory and Algorithms, 2nd edition, Springer, London, 2017.
doi: 10.1007/978-3-319-46024-6. |
[20] |
L. Grüne, M. Schaller and A. Schiela,
Sensitivity analysis of optimal control for a class of parabolic PDEs motivated by model predictive control, SIAM J. Control Optim., 57 (2019), 2753-2774.
doi: 10.1137/18M1223083. |
[21] |
L. Grüne and M. Stieler, Asymptotic stability and transient optimality of economic MPC without terminal conditions, J. Proc. Control, 24 (2014), 1187-1196. Google Scholar |
[22] |
L. Grüne, M. Schaller and A. Schiela,
Exponential sensitivity and turnpike analysis for linear quadratic optimal control of general evolution equations, J. Differ. Equ., 268 (2020), 7311-7341.
doi: 10.1016/j.jde.2019.11.064. |
[23] |
W. Hahn, Stability of Motion, Springer, 1967. |
[24] |
A. Porretta and E. Zuazua,
Long time versus steady state optimal control, SIAM J. Control Optim., 51 (2013), 4242-4273.
doi: 10.1137/130907239. |
[25] |
S. Primak, V. Kontorovich and V. Lyandres, Stochastic Methods and Their Applications to Communications, John Wiley & Sons, Inc., Hoboken, NJ, 2004. |
[26] |
P. E. Protter, Stochastic Integration and Differential Equations, vol. 21 of Stochastic Modelling and Applied Probability, Springer-Verlag, Berlin, 2005.
doi: 10.1007/978-3-662-10061-5. |
[27] |
J. B. Rawlings, D. Bonné, J. B. Jørgensen, A. N. Venkat and S. B. Jørgensen,
Unreachable setpoints in model predictive control, IEEE Transactions on Automatic Control, 53 (2008), 2209-2215.
doi: 10.1109/TAC.2008.928125. |
[28] |
J. B. Rawlings, D. Q. Mayne and M. M. Diehl, Model Predictive Control: Theory and Design, 2nd edition, Nob Hill Publishing, 2017. Google Scholar |
[29] |
H. Risken, The Fokker-Planck Equation, vol. 18 of Springer Series in Synergetics, 2nd edition, Springer-Verlag, Berlin, 1989.
doi: 10.1007/978-3-642-61544-3. |
[30] |
S. Roy, M. Annunziato and A. Borzì,
A Fokker-Planck feedback control-constrained approach for modelling crowd motion, J. Comput. Theor. Transp., 45 (2016), 442-458.
doi: 10.1080/23324309.2016.1189435. |
[31] |
E. Trélat and E. Zuazua,
The turnpike property in finite-dimensional nonlinear optimal control, J. Differential Equations, 258 (2015), 81-114.
doi: 10.1016/j.jde.2014.09.005. |
[32] |
E. Trélat, C. Zhang and E. Zuazua,
Steady-state and periodic exponential turnpike property for optimal control problems in Hilbert spaces, SIAM J. Control Optim., 56 (2018), 1222-1252.
doi: 10.1137/16M1097638. |
[33] |
F. Tröltzsch, Optimal Control of Partial Differential Equations, vol. 112 of Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2010.
doi: 10.1090/gsm/112. |
[34] |
J. C. Willems,
Dissipative dynamical systems. I. General theory, Arch. Rational Mech. Anal., 45 (1972), 321-351.
doi: 10.1007/BF00276493. |








[1] |
Yuan Tan, Qingyuan Cao, Lan Li, Tianshi Hu, Min Su. A chance-constrained stochastic model predictive control problem with disturbance feedback. Journal of Industrial & Management Optimization, 2021, 17 (1) : 67-79. doi: 10.3934/jimo.2019099 |
[2] |
Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020 doi: 10.3934/mcrf.2020046 |
[3] |
Lars Grüne, Roberto Guglielmi. On the relation between turnpike properties and dissipativity for continuous time linear quadratic optimal control problems. Mathematical Control & Related Fields, 2021, 11 (1) : 169-188. doi: 10.3934/mcrf.2020032 |
[4] |
Christian Clason, Vu Huu Nhu, Arnd Rösch. Optimal control of a non-smooth quasilinear elliptic equation. Mathematical Control & Related Fields, 2020 doi: 10.3934/mcrf.2020052 |
[5] |
Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019 |
[6] |
Jingrui Sun, Hanxiao Wang. Mean-field stochastic linear-quadratic optimal control problems: Weak closed-loop solvability. Mathematical Control & Related Fields, 2021, 11 (1) : 47-71. doi: 10.3934/mcrf.2020026 |
[7] |
Youming Guo, Tingting Li. Optimal control strategies for an online game addiction model with low and high risk exposure. Discrete & Continuous Dynamical Systems - B, 2020 doi: 10.3934/dcdsb.2020347 |
[8] |
Bernard Bonnard, Jérémy Rouot. Geometric optimal techniques to control the muscular force response to functional electrical stimulation using a non-isometric force-fatigue model. Journal of Geometric Mechanics, 2020 doi: 10.3934/jgm.2020032 |
[9] |
Wenyuan Wang, Ran Xu. General drawdown based dividend control with fixed transaction costs for spectrally negative Lévy risk processes. Journal of Industrial & Management Optimization, 2020 doi: 10.3934/jimo.2020179 |
[10] |
Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020 doi: 10.3934/eect.2020107 |
[11] |
Vaibhav Mehandiratta, Mani Mehra, Günter Leugering. Fractional optimal control problems on a star graph: Optimality system and numerical solution. Mathematical Control & Related Fields, 2021, 11 (1) : 189-209. doi: 10.3934/mcrf.2020033 |
[12] |
Hongbo Guan, Yong Yang, Huiqing Zhu. A nonuniform anisotropic FEM for elliptic boundary layer optimal control problems. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1711-1722. doi: 10.3934/dcdsb.2020179 |
[13] |
Tetsuya Ishiwata, Young Chol Yang. Numerical and mathematical analysis of blow-up problems for a stochastic differential equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 909-918. doi: 10.3934/dcdss.2020391 |
[14] |
Mikhail I. Belishev, Sergey A. Simonov. A canonical model of the one-dimensional dynamical Dirac system with boundary control. Evolution Equations & Control Theory, 2021 doi: 10.3934/eect.2021003 |
[15] |
Pierluigi Colli, Gianni Gilardi, Jürgen Sprekels. Deep quench approximation and optimal control of general Cahn–Hilliard systems with fractional operators and double obstacle potentials. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 243-271. doi: 10.3934/dcdss.2020213 |
[16] |
Stefan Doboszczak, Manil T. Mohan, Sivaguru S. Sritharan. Pontryagin maximum principle for the optimal control of linearized compressible navier-stokes equations with state constraints. Evolution Equations & Control Theory, 2020 doi: 10.3934/eect.2020110 |
[17] |
Elimhan N. Mahmudov. Infimal convolution and duality in convex optimal control problems with second order evolution differential inclusions. Evolution Equations & Control Theory, 2021, 10 (1) : 37-59. doi: 10.3934/eect.2020051 |
[18] |
Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133 |
[19] |
Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020 doi: 10.3934/dcdsb.2020317 |
[20] |
Yu Yuan, Zhibin Liang, Xia Han. Optimal investment and reinsurance to minimize the probability of drawdown with borrowing costs. Journal of Industrial & Management Optimization, 2020 doi: 10.3934/jimo.2021003 |
2019 Impact Factor: 0.857
Tools
Article outline
Figures and Tables
[Back to Top]