Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation

Previous Article
The control parameterization method for nonlinear optimal control: A survey
JIMO Home
This Issue
Next Article
Towards an optimization theory for deforming dense granular materials: Minimum cost maximum flow solutions

January 2014, 10(1): 311-336. doi: 10.3934/jimo.2014.10.311

Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation

Matthias Gerdts ^1, and Martin Kunkel ^2,

1.	Universität der Bundeswehr München, Institut für Mathematik und Rechneranwendung, Werner-Heisenberg-Weg 39, 85577 Neubiberg, Germany
2.	Elektrobit Automotive GmbH, Am Wolfsmantel 46, 91058 Erlangen, Germany

Received October 2012 Revised July 2013 Published October 2013

Abstract
Related Papers

We study convergence properties of Euler discretization of optimal control problems with ordinary differential equations and mixed control-state constraints. Under suitable consistency and stability assumptions a convergence rate of order $1/p$ of the discretized control to the continuous control is established in the $L^p$-norm. Throughout it is assumed that the optimal control is of bounded variation. The convergence proof exploits the reformulation of first order necessary optimality conditions as nonsmooth equations.

Keywords: bounded variation, control-state constraints, Optimal control, nonsmooth equation., discretization, convergence.

Mathematics Subject Classification: Primary: 49J15, 49J52, 49M25; Secondary: 49K4.

Citation: Matthias Gerdts, Martin Kunkel. Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation. Journal of Industrial & Management Optimization, 2014, 10 (1) : 311-336. doi: 10.3934/jimo.2014.10.311

References:

[1]	W. Alt, Discretization and mesh-independence of Newton's method for generalized equations,, in, 195 (1997), 1. Google Scholar
[2]	W. Alt, Mesh-independence of the Lagrange-Newton method for nonlinear optimal control problems and their discretizations,, Optimization with data perturbations, 101 (2001), 101. doi: 10.1023/A:1010912305365. Google Scholar
[3]	W. Alt, R. Baier, M. Gerdts and F. Lempio, Approximation of linear control problems with bang-bang solutions,, Optimization, 62 (2013), 9. doi: 10.1080/02331934.2011.568619. Google Scholar
[4]	W. Alt, R. Baier, M. Gerdts and F. Lempio, Error bounds for Euler approximation of linear-quadratic control problems with bang-bang solutions,, Numerical Algebra, 2 (2012), 547. doi: 10.3934/naco.2012.2.547. Google Scholar
[5]	N. Banihashemi and C. Y. Kaya, Inexact restoration for Euler discretization of box-constrained optimal control problems,, Journal of Optimization Theory and Applications, 156 (2013), 726. doi: 10.1007/s10957-012-0140-4. Google Scholar
[6]	C. Büskens, M. Gerdts, T. Nikolayzik, P. Kalmbach, M. Kunkel and D. Wassel, Homepage of the WORHP solver,, , (2010). Google Scholar
[7]	B. Chen, X. Chen and C. Kanzow, A penalized Fischer-Burmeister NCP-function,, Mathematical Programming, 88 (2000), 211. doi: 10.1007/PL00011375. Google Scholar
[8]	F. H. Clarke, "Optimization and Nonsmooth Analysis,'', Canadian Mathematical Society Series of Monographs and Advanced Texts, (1983). Google Scholar
[9]	A. L. Dontchev, W. W. Hager and K. Malanowski, Error bounds for Euler approximation of a state and control constrained optimal control problem,, Numerical Functional Analysis and Optimization, 21 (2000), 653. doi: 10.1080/01630560008816979. Google Scholar
[10]	A. L. Dontchev, W. W. Hager and V. M. Veliov, Second-order runge-kutta approximations in control constrained optimal control,, SIAM Journal on Numerical Analysis, 38 (2000), 202. doi: 10.1137/S0036142999351765. Google Scholar
[11]	I. S. Duff, MA57 - A code for the solution of sparse symmetric definite and indefinite systems,, ACM Transactions on Mathematical Software, 30 (2004), 118. doi: 10.1145/992200.992202. Google Scholar
[12]	C. Geiger and C. Kanzow, "Theorie und Numerik Restringierter Optimierungsaufgaben,'', Springer, (2002). doi: 10.1007/978-3-642-56004-0. Google Scholar
[13]	M. Gerdts, Global convergence of a nonsmooth Newton method for control-state constrained optimal control problems,, SIAM Journal on Optimization, 19 (2008), 326. doi: 10.1137/060657546. Google Scholar
[14]	M. Gerdts and B. Hüpping, Virtual control regularization of state constrained linear quadratic optimal control problems.,, Comput. Optim. Appl., 51 (2012), 867. doi: 10.1007/s10589-010-9353-3. Google Scholar
[15]	W. W. Hager, Runge-Kutta methods in optimal control and the transformed adjoint system,, Numerische Mathematik, 87 (2000), 247. doi: 10.1007/s002110000178. Google Scholar
[16]	H. Heuser, "Funktionalanalysis: Theorie und Anwendung,'', B. G. Teubner, (2006). Google Scholar
[17]	M. Josephy, Composing functions of bounded variation,, Proceedings of the American Mathematical Society, 83 (1981), 354. doi: 10.1090/S0002-9939-1981-0624930-9. Google Scholar
[18]	M. Kunkel, "Nonsmooth Newton Methods and Convergence of Discretized Optimal Control Problems Subject to DAEs,", PhD thesis, (2012), 706. Google Scholar
[19]	F. Lempio, Numerische mathematik II - methoden der analysis,, Bayreuther Mathematische Schriften, 55 (1998). Google Scholar
[20]	L. A. Ljusternik and W. I. Sobolew, "Elemente Der Funktionalanalysis,'', Fünfte Auflage. Übersetzung der zweiten russischen Auflage von Klaus Fiedler und herausgegeben von Konrad Gröger. Mathematische Lehrbücher und Monographien, (1976). Google Scholar
[21]	K. Malanowski, On normality of Lagrange multipliers for state constrained optimal control problems,, Optimization, 52 (2003), 75. doi: 10.1080/0233193021000058940. Google Scholar
[22]	K. Malanowski, Ch. Büskens and H. Maurer, Convergence of approximations to nonlinear optimal control problems,, in, (1998), 253. Google Scholar
[23]	M. McAsey, L. Mou and W. Han, Convergence of the forward-backward sweep method in optimal control,, Computational Optimization and Applications, 53 (2012), 207. doi: 10.1007/s10589-011-9454-7. Google Scholar
[24]	I. P. Natanson, "Theorie der Funktionen Einer Reellen Veränderlichen,'', Verlag Harri Deutsch, (1981). Google Scholar
[25]	R. Loxton, Q. Lin, V. Rehbock and K. L. Teo, Control parametrization for optimal control problems with continuous inequality constraints: New convergence results,, Numerical Algebra, 2 (2012), 571. doi: 10.3934/naco.2012.2.571. Google Scholar
[26]	H. J. Stetter, Analysis of discretization methods for ordinary differential equations,, In, 23 (1973). Google Scholar
[27]	D. Sun and L. Qi, On NCP-functions,, Computational optimization—a tribute to Olvi Mangasarian, 13 (1999), 201. doi: 10.1023/A:1008669226453. Google Scholar
[28]	V. M. Veliov, Error analysis of discrete approximations to bang-bang optimal control problems: The linear case,, Control Cybern., 34 (2005), 967. Google Scholar

show all references

References:

[1]	W. Alt, Discretization and mesh-independence of Newton's method for generalized equations,, in, 195 (1997), 1. Google Scholar
[2]	W. Alt, Mesh-independence of the Lagrange-Newton method for nonlinear optimal control problems and their discretizations,, Optimization with data perturbations, 101 (2001), 101. doi: 10.1023/A:1010912305365. Google Scholar
[3]	W. Alt, R. Baier, M. Gerdts and F. Lempio, Approximation of linear control problems with bang-bang solutions,, Optimization, 62 (2013), 9. doi: 10.1080/02331934.2011.568619. Google Scholar
[4]	W. Alt, R. Baier, M. Gerdts and F. Lempio, Error bounds for Euler approximation of linear-quadratic control problems with bang-bang solutions,, Numerical Algebra, 2 (2012), 547. doi: 10.3934/naco.2012.2.547. Google Scholar
[5]	N. Banihashemi and C. Y. Kaya, Inexact restoration for Euler discretization of box-constrained optimal control problems,, Journal of Optimization Theory and Applications, 156 (2013), 726. doi: 10.1007/s10957-012-0140-4. Google Scholar
[6]	C. Büskens, M. Gerdts, T. Nikolayzik, P. Kalmbach, M. Kunkel and D. Wassel, Homepage of the WORHP solver,, , (2010). Google Scholar
[7]	B. Chen, X. Chen and C. Kanzow, A penalized Fischer-Burmeister NCP-function,, Mathematical Programming, 88 (2000), 211. doi: 10.1007/PL00011375. Google Scholar
[8]	F. H. Clarke, "Optimization and Nonsmooth Analysis,'', Canadian Mathematical Society Series of Monographs and Advanced Texts, (1983). Google Scholar
[9]	A. L. Dontchev, W. W. Hager and K. Malanowski, Error bounds for Euler approximation of a state and control constrained optimal control problem,, Numerical Functional Analysis and Optimization, 21 (2000), 653. doi: 10.1080/01630560008816979. Google Scholar
[10]	A. L. Dontchev, W. W. Hager and V. M. Veliov, Second-order runge-kutta approximations in control constrained optimal control,, SIAM Journal on Numerical Analysis, 38 (2000), 202. doi: 10.1137/S0036142999351765. Google Scholar
[11]	I. S. Duff, MA57 - A code for the solution of sparse symmetric definite and indefinite systems,, ACM Transactions on Mathematical Software, 30 (2004), 118. doi: 10.1145/992200.992202. Google Scholar
[12]	C. Geiger and C. Kanzow, "Theorie und Numerik Restringierter Optimierungsaufgaben,'', Springer, (2002). doi: 10.1007/978-3-642-56004-0. Google Scholar
[13]	M. Gerdts, Global convergence of a nonsmooth Newton method for control-state constrained optimal control problems,, SIAM Journal on Optimization, 19 (2008), 326. doi: 10.1137/060657546. Google Scholar
[14]	M. Gerdts and B. Hüpping, Virtual control regularization of state constrained linear quadratic optimal control problems.,, Comput. Optim. Appl., 51 (2012), 867. doi: 10.1007/s10589-010-9353-3. Google Scholar
[15]	W. W. Hager, Runge-Kutta methods in optimal control and the transformed adjoint system,, Numerische Mathematik, 87 (2000), 247. doi: 10.1007/s002110000178. Google Scholar
[16]	H. Heuser, "Funktionalanalysis: Theorie und Anwendung,'', B. G. Teubner, (2006). Google Scholar
[17]	M. Josephy, Composing functions of bounded variation,, Proceedings of the American Mathematical Society, 83 (1981), 354. doi: 10.1090/S0002-9939-1981-0624930-9. Google Scholar
[18]	M. Kunkel, "Nonsmooth Newton Methods and Convergence of Discretized Optimal Control Problems Subject to DAEs,", PhD thesis, (2012), 706. Google Scholar
[19]	F. Lempio, Numerische mathematik II - methoden der analysis,, Bayreuther Mathematische Schriften, 55 (1998). Google Scholar
[20]	L. A. Ljusternik and W. I. Sobolew, "Elemente Der Funktionalanalysis,'', Fünfte Auflage. Übersetzung der zweiten russischen Auflage von Klaus Fiedler und herausgegeben von Konrad Gröger. Mathematische Lehrbücher und Monographien, (1976). Google Scholar
[21]	K. Malanowski, On normality of Lagrange multipliers for state constrained optimal control problems,, Optimization, 52 (2003), 75. doi: 10.1080/0233193021000058940. Google Scholar
[22]	K. Malanowski, Ch. Büskens and H. Maurer, Convergence of approximations to nonlinear optimal control problems,, in, (1998), 253. Google Scholar
[23]	M. McAsey, L. Mou and W. Han, Convergence of the forward-backward sweep method in optimal control,, Computational Optimization and Applications, 53 (2012), 207. doi: 10.1007/s10589-011-9454-7. Google Scholar
[24]	I. P. Natanson, "Theorie der Funktionen Einer Reellen Veränderlichen,'', Verlag Harri Deutsch, (1981). Google Scholar
[25]	R. Loxton, Q. Lin, V. Rehbock and K. L. Teo, Control parametrization for optimal control problems with continuous inequality constraints: New convergence results,, Numerical Algebra, 2 (2012), 571. doi: 10.3934/naco.2012.2.571. Google Scholar
[26]	H. J. Stetter, Analysis of discretization methods for ordinary differential equations,, In, 23 (1973). Google Scholar
[27]	D. Sun and L. Qi, On NCP-functions,, Computational optimization—a tribute to Olvi Mangasarian, 13 (1999), 201. doi: 10.1023/A:1008669226453. Google Scholar
[28]	V. M. Veliov, Error analysis of discrete approximations to bang-bang optimal control problems: The linear case,, Control Cybern., 34 (2005), 967. Google Scholar

[1]	Huaiqiang Yu, Bin Liu. Pontryagin's principle for local solutions of optimal control governed by the 2D Navier-Stokes equations with mixed control-state constraints. Mathematical Control & Related Fields, 2012, 2 (1) : 61-80. doi: 10.3934/mcrf.2012.2.61
[2]	Matthias Gerdts, Martin Kunkel. A nonsmooth Newton's method for discretized optimal control problems with state and control constraints. Journal of Industrial & Management Optimization, 2008, 4 (2) : 247-270. doi: 10.3934/jimo.2008.4.247
[3]	Md. Haider Ali Biswas, Maria do Rosário de Pinho. A nonsmooth maximum principle for optimal control problems with state and mixed constraints - convex case. Conference Publications, 2011, 2011 (Special) : 174-183. doi: 10.3934/proc.2011.2011.174
[4]	Thierry Horsin, Peter I. Kogut, Olivier Wilk. Optimal $L^2$-control problem in coefficients for a linear elliptic equation. II. Approximation of solutions and optimality conditions. Mathematical Control & Related Fields, 2016, 6 (4) : 595-628. doi: 10.3934/mcrf.2016017
[5]	Thierry Horsin, Peter I. Kogut. Optimal $L^2$-control problem in coefficients for a linear elliptic equation. I. Existence result. Mathematical Control & Related Fields, 2015, 5 (1) : 73-96. doi: 10.3934/mcrf.2015.5.73
[6]	Max Gunzburger, Sung-Dae Yang, Wenxiang Zhu. Analysis and discretization of an optimal control problem for the forced Fisher equation. Discrete & Continuous Dynamical Systems - B, 2007, 8 (3) : 569-587. doi: 10.3934/dcdsb.2007.8.569
[7]	Luís Tiago Paiva, Fernando A. C. C. Fontes. Adaptive time--mesh refinement in optimal control problems with state constraints. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4553-4572. doi: 10.3934/dcds.2015.35.4553
[8]	Theodore Tachim-Medjo. Optimal control of a two-phase flow model with state constraints. Mathematical Control & Related Fields, 2016, 6 (2) : 335-362. doi: 10.3934/mcrf.2016006
[9]	Vincenzo Basco, Piermarco Cannarsa, Hélène Frankowska. Necessary conditions for infinite horizon optimal control problems with state constraints. Mathematical Control & Related Fields, 2018, 8 (3&4) : 535-555. doi: 10.3934/mcrf.2018022
[10]	Ryan Loxton, Qun Lin, Volker Rehbock, Kok Lay Teo. Control parameterization for optimal control problems with continuous inequality constraints: New convergence results. Numerical Algebra, Control & Optimization, 2012, 2 (3) : 571-599. doi: 10.3934/naco.2012.2.571
[11]	Piermarco Cannarsa, Hélène Frankowska, Elsa M. Marchini. On Bolza optimal control problems with constraints. Discrete & Continuous Dynamical Systems - B, 2009, 11 (3) : 629-653. doi: 10.3934/dcdsb.2009.11.629
[12]	M. Arisawa, P.-L. Lions. Continuity of admissible trajectories for state constraints control problems. Discrete & Continuous Dynamical Systems - A, 1996, 2 (3) : 297-305. doi: 10.3934/dcds.1996.2.297
[13]	Mikhail Gusev. On reachability analysis for nonlinear control systems with state constraints. Conference Publications, 2015, 2015 (special) : 579-587. doi: 10.3934/proc.2015.0579
[14]	Christian Clason, Barbara Kaltenbacher. Avoiding degeneracy in the Westervelt equation by state constrained optimal control. Evolution Equations & Control Theory, 2013, 2 (2) : 281-300. doi: 10.3934/eect.2013.2.281
[15]	Cristiana J. Silva, Helmut Maurer, Delfim F. M. Torres. Optimal control of a Tuberculosis model with state and control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 321-337. doi: 10.3934/mbe.2017021
[16]	Ying Zhang, Changjun Yu, Yingtao Xu, Yanqin Bai. Minimizing almost smooth control variation in nonlinear optimal control problems. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-21. doi: 10.3934/jimo.2019023
[17]	Maria do Rosário de Pinho, Ilya Shvartsman. Lipschitz continuity of optimal control and Lagrange multipliers in a problem with mixed and pure state constraints. Discrete & Continuous Dynamical Systems - A, 2011, 29 (2) : 505-522. doi: 10.3934/dcds.2011.29.505
[18]	Elimhan N. Mahmudov. Optimal control of second order delay-discrete and delay-differential inclusions with state constraints. Evolution Equations & Control Theory, 2018, 7 (3) : 501-529. doi: 10.3934/eect.2018024
[19]	Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082
[20]	Takeshi Ohtsuka, Ken Shirakawa, Noriaki Yamazaki. Optimal control problem for Allen-Cahn type equation associated with total variation energy. Discrete & Continuous Dynamical Systems - S, 2012, 5 (1) : 159-181. doi: 10.3934/dcdss.2012.5.159

2018 Impact Factor: 1.025

American Institute of Mathematical Sciences