American Institute of Mathematical Sciences

Advanced
March  2020, 10(1): 39-41. doi: 10.3934/naco.2019031

Initial guess sensitivity in computational optimal control problems

John T. Betts 1, , Stephen L. Campbell 2,, and  Claire Digirolamo 2,

1. 

Applied Mathematical Analysis, 24748 SE Mirromont Pl., Issaquah, WA 98027, USA
2. 

Department of Mathematics, North Carolina State University, Raleigh, NC, 27695-8205, USA

* Corresponding author: Stephen L Campbell

Received  July 2018 Revised  April 2019 Published  May 2019

An optimal control problem is presented that exhibited unexpected initial guess dependence when being solved with direct transcription methods. This note presents that example and the cautionary tale it provides.

Keywords: Optimal control, initial guesses, interior point methods, IPOPT, GPOPS II.
Mathematics Subject Classification: Primary: 49M37; Secondary: 49K40, 49M25.
Citation: John T. Betts, Stephen L. Campbell, Claire Digirolamo. Initial guess sensitivity in computational optimal control problems. Numerical Algebra, Control & Optimization, 2020, 10 (1) : 39-41. doi: 10.3934/naco.2019031
References:
[1]

J. T. Betts, Methods for Optimal Control and Estimation using Nonlinear Programming, SIAM, Philadelphia, 2010. Google Scholar

[2]

C. L. Darby, W. W. Hager and A. V. Rao, An hp-adaptive pseudospectral method for solving optimal control problems, Optimal Control Applications and Methods, 32 (2011), 476-502.  doi: 10.1002/oca.957.  Google Scholar

[3]

A. Forsgren, On warm starts for interior methods, in System Modeling and Optimization, IFIP International Federation for Information Processing (eds. F. Ceragioli, A. Dontchev, H. Furuta, K. Marti, and L. P. Pandolfi), Springer, Boston, 199 (2006), 51–66. doi: 10.1007/0-387-33006-2_6.  Google Scholar

[4]

M. A. Patterson and A. V. Rao, GPOPS II: A MATLAB software for solving multiple-phase optimal control problems using hp-adaptive Gaussian quadrature collocation methods and sparse nonlinear programming, ACM Transactions Mathematical Software, 41 (2014), 1-37.  doi: 10.1145/2558904.  Google Scholar

[5]

A. V. Rao, D. A. Benson, C. Darby, M. A. Patterson, C. Francolin, I. Sanders and G. T. Huntington, Algorithm 902: Gpops, a MATLAB software for solving multiple-phase optimal control problems using the Gauss pseudospectral method, ACM Transactions Mathematical Software, 37 (2010), 22: 1–22: 39. doi: 10.1145/2558904.  Google Scholar

[6]

A. Wächter and L. T. Biegler, On the implementation of a primal-dual interior point filter line search algorithm for large-scale nonlinear programming, Mathematical Programming, 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.  Google Scholar

[7]

A. Wächter and L. T. Biegler, Failure of global convergence for a class of interior point methods for nonlinear programming, Mathematical Programming, 88 (2000), 565-574.  doi: 10.1007/PL00011386.  Google Scholar

[8]

E. A. Yildirim and S. J. Wright, Warm start strategies in interior-point methods for linear programming, SIAM J. Optimization, 12 (2002), 782-810.  doi: 10.1137/S1052623400369235.  Google Scholar

[9]

E. A. Yildirim, Implementation of warm-start strategies in interior-point methods for linear programming in fixed dimensions, Computational Optimization and Applications, 41 (2008), 151-183.  doi: 10.1007/s10589-007-9096-y.  Google Scholar

show all references

References:
[1]

J. T. Betts, Methods for Optimal Control and Estimation using Nonlinear Programming, SIAM, Philadelphia, 2010. Google Scholar

[2]

C. L. Darby, W. W. Hager and A. V. Rao, An hp-adaptive pseudospectral method for solving optimal control problems, Optimal Control Applications and Methods, 32 (2011), 476-502.  doi: 10.1002/oca.957.  Google Scholar

[3]

A. Forsgren, On warm starts for interior methods, in System Modeling and Optimization, IFIP International Federation for Information Processing (eds. F. Ceragioli, A. Dontchev, H. Furuta, K. Marti, and L. P. Pandolfi), Springer, Boston, 199 (2006), 51–66. doi: 10.1007/0-387-33006-2_6.  Google Scholar

[4]

M. A. Patterson and A. V. Rao, GPOPS II: A MATLAB software for solving multiple-phase optimal control problems using hp-adaptive Gaussian quadrature collocation methods and sparse nonlinear programming, ACM Transactions Mathematical Software, 41 (2014), 1-37.  doi: 10.1145/2558904.  Google Scholar

[5]

A. V. Rao, D. A. Benson, C. Darby, M. A. Patterson, C. Francolin, I. Sanders and G. T. Huntington, Algorithm 902: Gpops, a MATLAB software for solving multiple-phase optimal control problems using the Gauss pseudospectral method, ACM Transactions Mathematical Software, 37 (2010), 22: 1–22: 39. doi: 10.1145/2558904.  Google Scholar

[6]

A. Wächter and L. T. Biegler, On the implementation of a primal-dual interior point filter line search algorithm for large-scale nonlinear programming, Mathematical Programming, 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.  Google Scholar

[7]

A. Wächter and L. T. Biegler, Failure of global convergence for a class of interior point methods for nonlinear programming, Mathematical Programming, 88 (2000), 565-574.  doi: 10.1007/PL00011386.  Google Scholar

[8]

E. A. Yildirim and S. J. Wright, Warm start strategies in interior-point methods for linear programming, SIAM J. Optimization, 12 (2002), 782-810.  doi: 10.1137/S1052623400369235.  Google Scholar

[9]

E. A. Yildirim, Implementation of warm-start strategies in interior-point methods for linear programming in fixed dimensions, Computational Optimization and Applications, 41 (2008), 151-183.  doi: 10.1007/s10589-007-9096-y.  Google Scholar

Figure 1.  Graphs of computed optimal control $ w $ for Example (2) with DT approach and $ M = 2, T = 1. $
Figure Options

Download full-size image

Download as PowerPoint slide

Table 1.  Endpoints for Initial $ w $ guesses $ w_i $ for Example 2
$ i $ $ w_0 $ $ w_f $
1 1 0
2 -1 -1
3 1 -1
4 0 1
Table Options

Download as excel

$ i $ $ w_0 $ $ w_f $
1 1 0
2 -1 -1
3 1 -1
4 0 1
Table 2.  Adjusted Values of $ \eta(T) $ for Example (2) using DT and $ M = 2 $, $ T = 1 $ and 3 iterations for different values of $ \gamma^2 $ and $ w_i $
$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 5.3457 18.0613 18.0613
4.4 18.0613 5.3457 18.0613 5.3457
4.5 18.0613 18.0613 5.3457 5.3457
4.6 18.0613 18.0613 18.0613 18.0613
4.7 5.3457 5.3457 18.0613 5.3457
Table Options

Download as excel

$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 5.3457 18.0613 18.0613
4.4 18.0613 5.3457 18.0613 5.3457
4.5 18.0613 18.0613 5.3457 5.3457
4.6 18.0613 18.0613 18.0613 18.0613
4.7 5.3457 5.3457 18.0613 5.3457
Table 3.  Rerun of the results reported in Table Table 2. Bold entries have changed from Table 2
$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 5.3457 18.0613 18.0613
4.4 18.0613 5.3457 18.0613 5.3457
4.5 18.0613 18.0613 5.3457 5.3457
4.6 5.3457 18.0613 5.3457 18.0613
4.7 5.3457 5.3457 18.0613 5.3457
Table Options

Download as excel

$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 5.3457 18.0613 18.0613
4.4 18.0613 5.3457 18.0613 5.3457
4.5 18.0613 18.0613 5.3457 5.3457
4.6 5.3457 18.0613 5.3457 18.0613
4.7 5.3457 5.3457 18.0613 5.3457
Table 4.  Adjusted Values of $ \eta(T) $ for Example (2) using DT and $ M = 2 $, $ T = 1 $ and 3 iterations for cost (3)
$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 18.0613 5.3457 18.0613
4.4 18.0613 18.0613 5.3457 5.3457
4.5 18.0613 18.0613 5.3457 18.0613
4.6 18.0613 18.0613 5.3457 18.0613
4.7 18.0613 18.0613 5.3457 5.3457
Table Options

Download as excel

$ \gamma^2 $ $ w_1 $ $ w_2 $ $ w_3 $ $ w_4 $
4.3 18.0613 18.0613 5.3457 18.0613
4.4 18.0613 18.0613 5.3457 5.3457
4.5 18.0613 18.0613 5.3457 18.0613
4.6 18.0613 18.0613 5.3457 18.0613
4.7 18.0613 18.0613 5.3457 5.3457
[1]

Justin Holmer, Chang Liu. Blow-up for the 1D nonlinear Schrödinger equation with point nonlinearity II: Supercritical blow-up profiles. Communications on Pure & Applied Analysis, 2021, 20 (1) : 215-242. doi: 10.3934/cpaa.2020264
[2]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[3]

Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020046
[4]

Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020107
[5]

Vaibhav Mehandiratta, Mani Mehra, Günter Leugering. Fractional optimal control problems on a star graph: Optimality system and numerical solution. Mathematical Control & Related Fields, 2021, 11 (1) : 189-209. doi: 10.3934/mcrf.2020033
[6]

Christian Clason, Vu Huu Nhu, Arnd Rösch. Optimal control of a non-smooth quasilinear elliptic equation. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020052
[7]

Hongbo Guan, Yong Yang, Huiqing Zhu. A nonuniform anisotropic FEM for elliptic boundary layer optimal control problems. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1711-1722. doi: 10.3934/dcdsb.2020179
[8]

Youming Guo, Tingting Li. Optimal control strategies for an online game addiction model with low and high risk exposure. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020347
[9]

Pierluigi Colli, Gianni Gilardi, Jürgen Sprekels. Deep quench approximation and optimal control of general Cahn–Hilliard systems with fractional operators and double obstacle potentials. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 243-271. doi: 10.3934/dcdss.2020213
[10]

Stefan Doboszczak, Manil T. Mohan, Sivaguru S. Sritharan. Pontryagin maximum principle for the optimal control of linearized compressible navier-stokes equations with state constraints. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020110
[11]

Elimhan N. Mahmudov. Infimal convolution and duality in convex optimal control problems with second order evolution differential inclusions. Evolution Equations & Control Theory, 2021, 10 (1) : 37-59. doi: 10.3934/eect.2020051
[12]

Lars Grüne, Roberto Guglielmi. On the relation between turnpike properties and dissipativity for continuous time linear quadratic optimal control problems. Mathematical Control & Related Fields, 2021, 11 (1) : 169-188. doi: 10.3934/mcrf.2020032
[13]

Jingrui Sun, Hanxiao Wang. Mean-field stochastic linear-quadratic optimal control problems: Weak closed-loop solvability. Mathematical Control & Related Fields, 2021, 11 (1) : 47-71. doi: 10.3934/mcrf.2020026
[14]

Arthur Fleig, Lars Grüne. Strict dissipativity analysis for classes of optimal control problems involving probability density functions. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020053
[15]

Bernard Bonnard, Jérémy Rouot. Geometric optimal techniques to control the muscular force response to functional electrical stimulation using a non-isometric force-fatigue model. Journal of Geometric Mechanics, 2020  doi: 10.3934/jgm.2020032
[16]

Fioralba Cakoni, Pu-Zhao Kow, Jenn-Nan Wang. The interior transmission eigenvalue problem for elastic waves in media with obstacles. Inverse Problems & Imaging, , () : -. doi: 10.3934/ipi.2020075
[17]

Xiaofeng Ren, David Shoup. The impact of the domain boundary on an inhibitory system: Interior discs and boundary half discs. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3957-3979. doi: 10.3934/dcds.2020048
[18]

Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077
[19]

Scipio Cuccagna, Masaya Maeda. A survey on asymptotic stability of ground states of nonlinear Schrödinger equations II. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020450
[20]

Nguyen Huy Tuan. On an initial and final value problem for fractional nonclassical diffusion equations of Kirchhoff type. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020354

 Impact Factor: 

Tools

Metrics

  • PDF downloads (233)
  • HTML views (704)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences