American Institute of Mathematical Sciences

Advanced
May  2019, 24(5): 2219-2235. doi: 10.3934/dcdsb.2019092

On numerical methods for singular optimal control problems: An application to an AUV problem

Z. Foroozandeh 1,, , Maria do rosário de Pinho 1, and  M. Shamsi 2,

1. 

Faculdade de Engenharia Universidade do Porto, DEEC, Porto, Portugal
2. 

Department of Applied Mathematics, Faculty of Mathematics and Computer Science, Amirkabir University of Technology, No. 424, Hafez Ave., Tehran, Iran

* Corresponding author: Z. Foroozandeh

Received  January 2018 Revised  January 2019 Published  May 2019 Early access  March 2019

We discuss and compare numerical methods to solve singular optimal control problems by the direct method. Our discussion is illustrated by an Autonomous Underwater Vehicle (AUV) problem with state constraints. For this problem, we test four different approaches to solve numerically our problem via the direct method. After discretizing the optimal control problem we solve the resulting optimization problem with (ⅰ) A Mathematical Programming Language ($ \text{AMPL} $), (ⅱ) the Imperial College London Optimal Control Software ($ \text{ICLOCS} $), (ⅲ) the Gauss Pseudospectral Optimization Software ($ \text{GPOPS} $) as well as with (ⅳ) a new algorithm based on mixed-binary non-linear programming reported in [7]. This algorithm consists on converting the optimal control problem to a Mixed Binary Optimal Control (MBOC) problem which is then transcribed to a mixed binary non-linear programming problem ($ \text{MBNLP} $) problem using Legendre-Radau pseudospectral method. Our case study shows that, in contrast with the first three approaches we test (all relying on $ \text{IPOPT} $ or other numerical optimization software packages like $ \text{KNITRO} $), the $ \text{MBOC} $ approach detects the structure of the AUV's problem without a priori information of optimal control and computes the switching times accurately.

Keywords: Singular optimal control problem, switching points, AUV's problem, Legendre-Gauss-Radau pseudospectral method, mixed-binary non-linear programming, mixed-binary optimal control, ICLOCS, GPOPS, Implicit Euler Method.
Mathematics Subject Classification: Primary: 49J30, 65K05; Secondary: 49M37.
Citation: Z. Foroozandeh, Maria do rosário de Pinho, M. Shamsi. On numerical methods for singular optimal control problems: An application to an AUV problem. Discrete & Continuous Dynamical Systems - B, 2019, 24 (5) : 2219-2235. doi: 10.3934/dcdsb.2019092
References:
[1]

R. Baltensperger and M. R. Trummer, Spectral differencing with a twist., SIAM J. Sci. Comput., 24 (2003), 1465-1487.  doi: 10.1137/S1064827501388182.  Google Scholar

[2]

J. T. Betts, Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, vol. 19 of Advances in Design and Control, 2nd edition, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2010. doi: 10.1137/1.9780898718577.  Google Scholar

[3]

R. Byrd, J. Nocedal and R. Waltz, Knitro: An integrated package for nonlinear optimization, in Large-Scale Nonlinear Optimization (eds. G. Di Pillo and M. Roma), vol. 83 of Nonconvex Optimization and Its Applications, Springer US, 2006, 35–59. doi: 10.1007/0-387-30065-1_4.  Google Scholar

[4]

C. Canuto, M. Y. Hussaini, A. Quarteroni and T. A. Zang, Spectral Methods in Fluid Dynamics, Springer Series in Computational Physics, Springer-Verlag, New York, 1988. doi: 10.1007/978-3-642-84108-8.  Google Scholar

[5]

M. d. R. de Pinho, Z. Foroozandeh and A. Matos, Optimal control problems for path planing of auv using simplified models, in 2016 IEEE 55th Conference on Decision and Control (CDC), 2016,210–215. doi: 10.1109/CDC.2016.7798271.  Google Scholar

[6]

B. Fornberg, A Practical Guide to Pseudospectral Methods, vol. 1 of Cambridge Monographs on Applied and Computational Mathematics, Cambridge University Press, Cambridge, 1996. doi: 10.1017/CBO9780511626357.  Google Scholar

[7]

Z. Foroozandeh, M. Shamsi and M. d. R. de Pinho, A mixed-binary non-linear programming approach for the numerical solution of a family of singular optimal control problems, International Journal of Control, 1–16. Google Scholar

[8]

Z. Foroozandeh, M. Shamsi and M. d. R. De Pinho, A hybrid direct–indirect approach for solving the singular optimal control problems of finite and infinite order, Iranian Journal of Science and Technology, Transactions A: Science, 42 (2018), 1545-1554.  doi: 10.1007/s40995-017-0176-2.  Google Scholar

[9]

Z. Foroozandeh, M. Shamsi, V. Azhmyakov and M. Shafiee, A modified pseudospectral method for solving trajectory optimization problems with singular arc, Mathematical Methods in the Applied Sciences, 40 (2017), 1783-1793.  doi: 10.1002/mma.4097.  Google Scholar

[10]

R. Fourer, D. M. Gay and B. Kernighan, Algorithms and model formulations in mathematical programming, Springer-Verlag New York, Inc., New York, NY, USA, 1989, chapter AMPL: A Mathematical Programming Language, 150–151. Google Scholar

[11]

D. Garg, Advances in Global Pseudospectral Methods for Optimal Control, PhD thesis, 2011, Thesis (Ph.D.)–University of Florida.  Google Scholar

[12]

D. Garg, M. Patterson, W. W. Hager, A. V. Rao, D. A. Benson and G. T. Huntington, A unified framework for the numerical solution of optimal control problems using pseudospectral methods, Automatica, 46 (2010), 1843-1851.  doi: 10.1016/j.automatica.2010.06.048.  Google Scholar

[13]

H. Maurer, Numerical solution of singular control problems using multiple shooting techniques, J. Optimization Theory Appl., 18 (1976), 235-257.  doi: 10.1007/BF00935706.  Google Scholar

[14]

H. Maurer, On optimal control problems with bounded state variables and control appearing linearly, SIAM J. Control Optim., 15 (1977), 345-362.  doi: 10.1137/0315023.  Google Scholar

[15]

M. A. Patterson and A. V. Rao, GPOPS-Ⅱ: A matlab software for solving multiple-phase optimal control problems using hp-adaptive gaussian quadrature collocation methods and sparse nonlinear programming, ACM Trans. Math. Softw., 41 (2014), Art. 1, 37 pp. doi: 10.1145/2558904.  Google Scholar

[16]

P. D. Pinto da Silva, Planeamento Otimizado de Movimento de Robot Submarino, (universidade do porto, faculdade de engenharia, msc thesis), 2014. Google Scholar

[17]

L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt, Interscience Publishers John Wiley & Sons, Inc. New York-London, 1962.  Google Scholar

[18]

S. Takriti, R. Fourer, M. Gay and B. Kernighan, Ampl: A Modeling Language for Mathematical Programming, 1994. Google Scholar

[19]

E. J. Van Wyk, P. Falugi and E. C. Kerrigan, Iclocs, 2010, URL http://www.ee.ic.ac.uk/ICLOCS. Google Scholar

[20]

R. Vinter, Optimal Control, Birkhäuser Basel, 2010. doi: 10.1007/978-0-8176-8086-2.  Google Scholar

[21]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program., 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.  Google Scholar

[22]

J. A. C. Weideman and S. C. Reddy, A MATLAB differentiation matrix suite, ACM Trans. Math. Software, 26 (2000), 465-519.  doi: 10.1145/365723.365727.  Google Scholar

[23]

B. D. Welfert, Generation of pseudospectral differentiation matrices. I., SIAM J. Numer. Anal., 34 (1997), 1640-1657.  doi: 10.1137/S0036142993295545.  Google Scholar

show all references

References:
[1]

R. Baltensperger and M. R. Trummer, Spectral differencing with a twist., SIAM J. Sci. Comput., 24 (2003), 1465-1487.  doi: 10.1137/S1064827501388182.  Google Scholar

[2]

J. T. Betts, Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, vol. 19 of Advances in Design and Control, 2nd edition, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2010. doi: 10.1137/1.9780898718577.  Google Scholar

[3]

R. Byrd, J. Nocedal and R. Waltz, Knitro: An integrated package for nonlinear optimization, in Large-Scale Nonlinear Optimization (eds. G. Di Pillo and M. Roma), vol. 83 of Nonconvex Optimization and Its Applications, Springer US, 2006, 35–59. doi: 10.1007/0-387-30065-1_4.  Google Scholar

[4]

C. Canuto, M. Y. Hussaini, A. Quarteroni and T. A. Zang, Spectral Methods in Fluid Dynamics, Springer Series in Computational Physics, Springer-Verlag, New York, 1988. doi: 10.1007/978-3-642-84108-8.  Google Scholar

[5]

M. d. R. de Pinho, Z. Foroozandeh and A. Matos, Optimal control problems for path planing of auv using simplified models, in 2016 IEEE 55th Conference on Decision and Control (CDC), 2016,210–215. doi: 10.1109/CDC.2016.7798271.  Google Scholar

[6]

B. Fornberg, A Practical Guide to Pseudospectral Methods, vol. 1 of Cambridge Monographs on Applied and Computational Mathematics, Cambridge University Press, Cambridge, 1996. doi: 10.1017/CBO9780511626357.  Google Scholar

[7]

Z. Foroozandeh, M. Shamsi and M. d. R. de Pinho, A mixed-binary non-linear programming approach for the numerical solution of a family of singular optimal control problems, International Journal of Control, 1–16. Google Scholar

[8]

Z. Foroozandeh, M. Shamsi and M. d. R. De Pinho, A hybrid direct–indirect approach for solving the singular optimal control problems of finite and infinite order, Iranian Journal of Science and Technology, Transactions A: Science, 42 (2018), 1545-1554.  doi: 10.1007/s40995-017-0176-2.  Google Scholar

[9]

Z. Foroozandeh, M. Shamsi, V. Azhmyakov and M. Shafiee, A modified pseudospectral method for solving trajectory optimization problems with singular arc, Mathematical Methods in the Applied Sciences, 40 (2017), 1783-1793.  doi: 10.1002/mma.4097.  Google Scholar

[10]

R. Fourer, D. M. Gay and B. Kernighan, Algorithms and model formulations in mathematical programming, Springer-Verlag New York, Inc., New York, NY, USA, 1989, chapter AMPL: A Mathematical Programming Language, 150–151. Google Scholar

[11]

D. Garg, Advances in Global Pseudospectral Methods for Optimal Control, PhD thesis, 2011, Thesis (Ph.D.)–University of Florida.  Google Scholar

[12]

D. Garg, M. Patterson, W. W. Hager, A. V. Rao, D. A. Benson and G. T. Huntington, A unified framework for the numerical solution of optimal control problems using pseudospectral methods, Automatica, 46 (2010), 1843-1851.  doi: 10.1016/j.automatica.2010.06.048.  Google Scholar

[13]

H. Maurer, Numerical solution of singular control problems using multiple shooting techniques, J. Optimization Theory Appl., 18 (1976), 235-257.  doi: 10.1007/BF00935706.  Google Scholar

[14]

H. Maurer, On optimal control problems with bounded state variables and control appearing linearly, SIAM J. Control Optim., 15 (1977), 345-362.  doi: 10.1137/0315023.  Google Scholar

[15]

M. A. Patterson and A. V. Rao, GPOPS-Ⅱ: A matlab software for solving multiple-phase optimal control problems using hp-adaptive gaussian quadrature collocation methods and sparse nonlinear programming, ACM Trans. Math. Softw., 41 (2014), Art. 1, 37 pp. doi: 10.1145/2558904.  Google Scholar

[16]

P. D. Pinto da Silva, Planeamento Otimizado de Movimento de Robot Submarino, (universidade do porto, faculdade de engenharia, msc thesis), 2014. Google Scholar

[17]

L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt, Interscience Publishers John Wiley & Sons, Inc. New York-London, 1962.  Google Scholar

[18]

S. Takriti, R. Fourer, M. Gay and B. Kernighan, Ampl: A Modeling Language for Mathematical Programming, 1994. Google Scholar

[19]

E. J. Van Wyk, P. Falugi and E. C. Kerrigan, Iclocs, 2010, URL http://www.ee.ic.ac.uk/ICLOCS. Google Scholar

[20]

R. Vinter, Optimal Control, Birkhäuser Basel, 2010. doi: 10.1007/978-0-8176-8086-2.  Google Scholar

[21]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program., 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.  Google Scholar

[22]

J. A. C. Weideman and S. C. Reddy, A MATLAB differentiation matrix suite, ACM Trans. Math. Software, 26 (2000), 465-519.  doi: 10.1145/365723.365727.  Google Scholar

[23]

B. D. Welfert, Generation of pseudospectral differentiation matrices. I., SIAM J. Numer. Anal., 34 (1997), 1640-1657.  doi: 10.1137/S0036142993295545.  Google Scholar

Figure 4.  Controls computed by the method of section 3.2 with $ s = 5 $ and $ n = 20 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 1.  The control functions using implicit Euler method computed with AMPL interfaced with IPOPTS with $ N = 10000 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  The control function computed by ICLOCS with $ N = 10000 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  The control function computed by GPOPS with $ N = 40 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Control computed by the method of section 3.2 with $ s = 4 $ and $ n = 14 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  States computed by the method of section 3.2 with $ s = 4 $ and $ n = 20 $
Figure Options

Download full-size image

Download as PowerPoint slide

Table 1.  AUV's Problem: computed values of switching times and performance index for $ s = 4 $ and various values of $ n $
$ n $ $ t_1 $ $ t_2 $ $ t_3 $ $ t_4 $ $ t_f $
6 0.049341739 0.6454231790 14.626412022 14.72348234 14.956410213
8 0.049051513 0.6456145668 14.623890223 14.72412511 14.950131513
10 0.049052155 0.6456134127 14.623817123 14.72416201 14.950161798
12 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
14 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
Table Options

Download as excel

$ n $ $ t_1 $ $ t_2 $ $ t_3 $ $ t_4 $ $ t_f $
6 0.049341739 0.6454231790 14.626412022 14.72348234 14.956410213
8 0.049051513 0.6456145668 14.623890223 14.72412511 14.950131513
10 0.049052155 0.6456134127 14.623817123 14.72416201 14.950161798
12 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
14 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
Table 2.  Comparing results for AUV's problem with no initial guess
$ \text{Methods} $ $ N $ $ t_i $ $ \mathcal{J} $ $ \text{Iter} $ $ \text{CPU Time} $
$ \text{Euler} $ 1000 $ \text{Not available explicitly} $ 14.941407 180 1809.557
$ \text{ICLOCS} $ 1000 $ \text{Not available explicitly} $ 14.943225 1075 20.265
$ \text{GPOPS} $ 80 $ \text{Not available explicitly} $ 14.949946 20682 1027.5
Section 3.2 14 Explicitly available 14.950161 6 4.472
Table Options

Download as excel

$ \text{Methods} $ $ N $ $ t_i $ $ \mathcal{J} $ $ \text{Iter} $ $ \text{CPU Time} $
$ \text{Euler} $ 1000 $ \text{Not available explicitly} $ 14.941407 180 1809.557
$ \text{ICLOCS} $ 1000 $ \text{Not available explicitly} $ 14.943225 1075 20.265
$ \text{GPOPS} $ 80 $ \text{Not available explicitly} $ 14.949946 20682 1027.5
Section 3.2 14 Explicitly available 14.950161 6 4.472
[1]

Ying Hu, Shanjian Tang. Mixed deterministic and random optimal control of linear stochastic systems with quadratic costs. Probability, Uncertainty and Quantitative Risk, 2019, 4 (0) : 1-. doi: 10.1186/s41546-018-0035-x
[2]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control & Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487
[3]

Maria do Rosário de Pinho, Ilya Shvartsman. Lipschitz continuity of optimal control and Lagrange multipliers in a problem with mixed and pure state constraints. Discrete & Continuous Dynamical Systems, 2011, 29 (2) : 505-522. doi: 10.3934/dcds.2011.29.505
[4]

Georg Vossen, Torsten Hermanns. On an optimal control problem in laser cutting with mixed finite-/infinite-dimensional constraints. Journal of Industrial & Management Optimization, 2014, 10 (2) : 503-519. doi: 10.3934/jimo.2014.10.503
[5]

Kareem T. Elgindy. Optimal control of a parabolic distributed parameter system using a fully exponentially convergent barycentric shifted gegenbauer integral pseudospectral method. Journal of Industrial & Management Optimization, 2018, 14 (2) : 473-496. doi: 10.3934/jimo.2017056
[6]

Hamid Reza Marzban, Hamid Reza Tabrizidooz. Solution of nonlinear delay optimal control problems using a composite pseudospectral collocation method. Communications on Pure & Applied Analysis, 2010, 9 (5) : 1379-1389. doi: 10.3934/cpaa.2010.9.1379
[7]

Vladimir Gaitsgory, Alex Parkinson, Ilya Shvartsman. Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time. Discrete & Continuous Dynamical Systems - B, 2019, 24 (4) : 1743-1767. doi: 10.3934/dcdsb.2018235
[8]

Fabio Bagagiolo. An infinite horizon optimal control problem for some switching systems. Discrete & Continuous Dynamical Systems - B, 2001, 1 (4) : 443-462. doi: 10.3934/dcdsb.2001.1.443
[9]

Zhen-Zhen Tao, Bing Sun. Galerkin spectral method for elliptic optimal control problem with $L^2$-norm control constraint. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021220
[10]

Hang-Chin Lai, Jin-Chirng Lee, Shuh-Jye Chern. A variational problem and optimal control. Journal of Industrial & Management Optimization, 2011, 7 (4) : 967-975. doi: 10.3934/jimo.2011.7.967
[11]

Eduardo Casas, Fredi Tröltzsch. Sparse optimal control for the heat equation with mixed control-state constraints. Mathematical Control & Related Fields, 2020, 10 (3) : 471-491. doi: 10.3934/mcrf.2020007
[12]

Mohamed Aliane, Mohand Bentobache, Nacima Moussouni, Philippe Marthon. Direct method to solve linear-quadratic optimal control problems. Numerical Algebra, Control & Optimization, 2021, 11 (4) : 645-663. doi: 10.3934/naco.2021002
[13]

Tianliang Hou, Yanping Chen. Superconvergence for elliptic optimal control problems discretized by RT1 mixed finite elements and linear discontinuous elements. Journal of Industrial & Management Optimization, 2013, 9 (3) : 631-642. doi: 10.3934/jimo.2013.9.631
[14]

John T. Betts, Stephen Campbell, Claire Digirolamo. Examination of solving optimal control problems with delays using GPOPS-Ⅱ. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 283-305. doi: 10.3934/naco.2020026
[15]

Qun Lin, Ryan Loxton, Kok Lay Teo. The control parameterization method for nonlinear optimal control: A survey. Journal of Industrial & Management Optimization, 2014, 10 (1) : 275-309. doi: 10.3934/jimo.2014.10.275
[16]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[17]

Yi Cui, Xintong Fang, Gaoqi Liu, Bin Li. Trajectory optimization of UAV based on Hp-adaptive Radau pseudospectral method. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021201
[18]

Huaiqiang Yu, Bin Liu. Pontryagin's principle for local solutions of optimal control governed by the 2D Navier-Stokes equations with mixed control-state constraints. Mathematical Control & Related Fields, 2012, 2 (1) : 61-80. doi: 10.3934/mcrf.2012.2.61
[19]

Térence Bayen, Marc Mazade, Francis Mairet. Analysis of an optimal control problem connected to bioprocesses involving a saturated singular arc. Discrete & Continuous Dynamical Systems - B, 2015, 20 (1) : 39-58. doi: 10.3934/dcdsb.2015.20.39
[20]

Ellina Grigorieva, Evgenii Khailov, Andrei Korobeinikov. An optimal control problem in HIV treatment. Conference Publications, 2013, 2013 (special) : 311-322. doi: 10.3934/proc.2013.2013.311

2020 Impact Factor: 1.327

Tools

Metrics

  • PDF downloads (360)
  • HTML views (133)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy