American Institute of Mathematical Sciences

Advanced
May  2019, 24(5): 2219-2235. doi: 10.3934/dcdsb.2019092

On numerical methods for singular optimal control problems: An application to an AUV problem

Z. Foroozandeh 1,, , Maria do rosário de Pinho 1, and  M. Shamsi 2,

1. 

Faculdade de Engenharia Universidade do Porto, DEEC, Porto, Portugal
2. 

Department of Applied Mathematics, Faculty of Mathematics and Computer Science, Amirkabir University of Technology, No. 424, Hafez Ave., Tehran, Iran

* Corresponding author: Z. Foroozandeh

Received  January 2018 Revised  January 2019 Published  May 2019 Early access  March 2019

We discuss and compare numerical methods to solve singular optimal control problems by the direct method. Our discussion is illustrated by an Autonomous Underwater Vehicle (AUV) problem with state constraints. For this problem, we test four different approaches to solve numerically our problem via the direct method. After discretizing the optimal control problem we solve the resulting optimization problem with (ⅰ) A Mathematical Programming Language ($ \text{AMPL} $), (ⅱ) the Imperial College London Optimal Control Software ($ \text{ICLOCS} $), (ⅲ) the Gauss Pseudospectral Optimization Software ($ \text{GPOPS} $) as well as with (ⅳ) a new algorithm based on mixed-binary non-linear programming reported in [7]. This algorithm consists on converting the optimal control problem to a Mixed Binary Optimal Control (MBOC) problem which is then transcribed to a mixed binary non-linear programming problem ($ \text{MBNLP} $) problem using Legendre-Radau pseudospectral method. Our case study shows that, in contrast with the first three approaches we test (all relying on $ \text{IPOPT} $ or other numerical optimization software packages like $ \text{KNITRO} $), the $ \text{MBOC} $ approach detects the structure of the AUV's problem without a priori information of optimal control and computes the switching times accurately.

Keywords: Singular optimal control problem, switching points, AUV's problem, Legendre-Gauss-Radau pseudospectral method, mixed-binary non-linear programming, mixed-binary optimal control, ICLOCS, GPOPS, Implicit Euler Method.
Mathematics Subject Classification: Primary: 49J30, 65K05; Secondary: 49M37.
Citation: Z. Foroozandeh, Maria do rosário de Pinho, M. Shamsi. On numerical methods for singular optimal control problems: An application to an AUV problem. Discrete and Continuous Dynamical Systems - B, 2019, 24 (5) : 2219-2235. doi: 10.3934/dcdsb.2019092
References:
[1]

R. Baltensperger and M. R. Trummer, Spectral differencing with a twist., SIAM J. Sci. Comput., 24 (2003), 1465-1487.  doi: 10.1137/S1064827501388182.

[2]

J. T. Betts, Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, vol. 19 of Advances in Design and Control, 2nd edition, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2010. doi: 10.1137/1.9780898718577.

[3]

R. Byrd, J. Nocedal and R. Waltz, Knitro: An integrated package for nonlinear optimization, in Large-Scale Nonlinear Optimization (eds. G. Di Pillo and M. Roma), vol. 83 of Nonconvex Optimization and Its Applications, Springer US, 2006, 35–59. doi: 10.1007/0-387-30065-1_4.

[4]

C. Canuto, M. Y. Hussaini, A. Quarteroni and T. A. Zang, Spectral Methods in Fluid Dynamics, Springer Series in Computational Physics, Springer-Verlag, New York, 1988. doi: 10.1007/978-3-642-84108-8.

[5]

M. d. R. de Pinho, Z. Foroozandeh and A. Matos, Optimal control problems for path planing of auv using simplified models, in 2016 IEEE 55th Conference on Decision and Control (CDC), 2016,210–215. doi: 10.1109/CDC.2016.7798271.

[6]

B. Fornberg, A Practical Guide to Pseudospectral Methods, vol. 1 of Cambridge Monographs on Applied and Computational Mathematics, Cambridge University Press, Cambridge, 1996. doi: 10.1017/CBO9780511626357.

[7]

Z. Foroozandeh, M. Shamsi and M. d. R. de Pinho, A mixed-binary non-linear programming approach for the numerical solution of a family of singular optimal control problems, International Journal of Control, 1–16.

[8]

Z. Foroozandeh, M. Shamsi and M. d. R. De Pinho, A hybrid direct–indirect approach for solving the singular optimal control problems of finite and infinite order, Iranian Journal of Science and Technology, Transactions A: Science, 42 (2018), 1545-1554.  doi: 10.1007/s40995-017-0176-2.

[9]

Z. Foroozandeh, M. Shamsi, V. Azhmyakov and M. Shafiee, A modified pseudospectral method for solving trajectory optimization problems with singular arc, Mathematical Methods in the Applied Sciences, 40 (2017), 1783-1793.  doi: 10.1002/mma.4097.

[10]

R. Fourer, D. M. Gay and B. Kernighan, Algorithms and model formulations in mathematical programming, Springer-Verlag New York, Inc., New York, NY, USA, 1989, chapter AMPL: A Mathematical Programming Language, 150–151.

[11]

D. Garg, Advances in Global Pseudospectral Methods for Optimal Control, PhD thesis, 2011, Thesis (Ph.D.)–University of Florida.

[12]

D. Garg, M. Patterson, W. W. Hager, A. V. Rao, D. A. Benson and G. T. Huntington, A unified framework for the numerical solution of optimal control problems using pseudospectral methods, Automatica, 46 (2010), 1843-1851.  doi: 10.1016/j.automatica.2010.06.048.

[13]

H. Maurer, Numerical solution of singular control problems using multiple shooting techniques, J. Optimization Theory Appl., 18 (1976), 235-257.  doi: 10.1007/BF00935706.

[14]

H. Maurer, On optimal control problems with bounded state variables and control appearing linearly, SIAM J. Control Optim., 15 (1977), 345-362.  doi: 10.1137/0315023.

[15]

M. A. Patterson and A. V. Rao, GPOPS-Ⅱ: A matlab software for solving multiple-phase optimal control problems using hp-adaptive gaussian quadrature collocation methods and sparse nonlinear programming, ACM Trans. Math. Softw., 41 (2014), Art. 1, 37 pp. doi: 10.1145/2558904.

[16]

P. D. Pinto da Silva, Planeamento Otimizado de Movimento de Robot Submarino, (universidade do porto, faculdade de engenharia, msc thesis), 2014.

[17]

L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt, Interscience Publishers John Wiley & Sons, Inc. New York-London, 1962.

[18]

S. Takriti, R. Fourer, M. Gay and B. Kernighan, Ampl: A Modeling Language for Mathematical Programming, 1994.

[19]

E. J. Van Wyk, P. Falugi and E. C. Kerrigan, Iclocs, 2010, URL http://www.ee.ic.ac.uk/ICLOCS.

[20]

R. Vinter, Optimal Control, Birkhäuser Basel, 2010. doi: 10.1007/978-0-8176-8086-2.

[21]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program., 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.

[22]

J. A. C. Weideman and S. C. Reddy, A MATLAB differentiation matrix suite, ACM Trans. Math. Software, 26 (2000), 465-519.  doi: 10.1145/365723.365727.

[23]

B. D. Welfert, Generation of pseudospectral differentiation matrices. I., SIAM J. Numer. Anal., 34 (1997), 1640-1657.  doi: 10.1137/S0036142993295545.

show all references

References:
[1]

R. Baltensperger and M. R. Trummer, Spectral differencing with a twist., SIAM J. Sci. Comput., 24 (2003), 1465-1487.  doi: 10.1137/S1064827501388182.

[2]

J. T. Betts, Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, vol. 19 of Advances in Design and Control, 2nd edition, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2010. doi: 10.1137/1.9780898718577.

[3]

R. Byrd, J. Nocedal and R. Waltz, Knitro: An integrated package for nonlinear optimization, in Large-Scale Nonlinear Optimization (eds. G. Di Pillo and M. Roma), vol. 83 of Nonconvex Optimization and Its Applications, Springer US, 2006, 35–59. doi: 10.1007/0-387-30065-1_4.

[4]

C. Canuto, M. Y. Hussaini, A. Quarteroni and T. A. Zang, Spectral Methods in Fluid Dynamics, Springer Series in Computational Physics, Springer-Verlag, New York, 1988. doi: 10.1007/978-3-642-84108-8.

[5]

M. d. R. de Pinho, Z. Foroozandeh and A. Matos, Optimal control problems for path planing of auv using simplified models, in 2016 IEEE 55th Conference on Decision and Control (CDC), 2016,210–215. doi: 10.1109/CDC.2016.7798271.

[6]

B. Fornberg, A Practical Guide to Pseudospectral Methods, vol. 1 of Cambridge Monographs on Applied and Computational Mathematics, Cambridge University Press, Cambridge, 1996. doi: 10.1017/CBO9780511626357.

[7]

Z. Foroozandeh, M. Shamsi and M. d. R. de Pinho, A mixed-binary non-linear programming approach for the numerical solution of a family of singular optimal control problems, International Journal of Control, 1–16.

[8]

Z. Foroozandeh, M. Shamsi and M. d. R. De Pinho, A hybrid direct–indirect approach for solving the singular optimal control problems of finite and infinite order, Iranian Journal of Science and Technology, Transactions A: Science, 42 (2018), 1545-1554.  doi: 10.1007/s40995-017-0176-2.

[9]

Z. Foroozandeh, M. Shamsi, V. Azhmyakov and M. Shafiee, A modified pseudospectral method for solving trajectory optimization problems with singular arc, Mathematical Methods in the Applied Sciences, 40 (2017), 1783-1793.  doi: 10.1002/mma.4097.

[10]

R. Fourer, D. M. Gay and B. Kernighan, Algorithms and model formulations in mathematical programming, Springer-Verlag New York, Inc., New York, NY, USA, 1989, chapter AMPL: A Mathematical Programming Language, 150–151.

[11]

D. Garg, Advances in Global Pseudospectral Methods for Optimal Control, PhD thesis, 2011, Thesis (Ph.D.)–University of Florida.

[12]

D. Garg, M. Patterson, W. W. Hager, A. V. Rao, D. A. Benson and G. T. Huntington, A unified framework for the numerical solution of optimal control problems using pseudospectral methods, Automatica, 46 (2010), 1843-1851.  doi: 10.1016/j.automatica.2010.06.048.

[13]

H. Maurer, Numerical solution of singular control problems using multiple shooting techniques, J. Optimization Theory Appl., 18 (1976), 235-257.  doi: 10.1007/BF00935706.

[14]

H. Maurer, On optimal control problems with bounded state variables and control appearing linearly, SIAM J. Control Optim., 15 (1977), 345-362.  doi: 10.1137/0315023.

[15]

M. A. Patterson and A. V. Rao, GPOPS-Ⅱ: A matlab software for solving multiple-phase optimal control problems using hp-adaptive gaussian quadrature collocation methods and sparse nonlinear programming, ACM Trans. Math. Softw., 41 (2014), Art. 1, 37 pp. doi: 10.1145/2558904.

[16]

P. D. Pinto da Silva, Planeamento Otimizado de Movimento de Robot Submarino, (universidade do porto, faculdade de engenharia, msc thesis), 2014.

[17]

L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, Translated from the Russian by K. N. Trirogoff; edited by L. W. Neustadt, Interscience Publishers John Wiley & Sons, Inc. New York-London, 1962.

[18]

S. Takriti, R. Fourer, M. Gay and B. Kernighan, Ampl: A Modeling Language for Mathematical Programming, 1994.

[19]

E. J. Van Wyk, P. Falugi and E. C. Kerrigan, Iclocs, 2010, URL http://www.ee.ic.ac.uk/ICLOCS.

[20]

R. Vinter, Optimal Control, Birkhäuser Basel, 2010. doi: 10.1007/978-0-8176-8086-2.

[21]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program., 106 (2006), 25-57.  doi: 10.1007/s10107-004-0559-y.

[22]

J. A. C. Weideman and S. C. Reddy, A MATLAB differentiation matrix suite, ACM Trans. Math. Software, 26 (2000), 465-519.  doi: 10.1145/365723.365727.

[23]

B. D. Welfert, Generation of pseudospectral differentiation matrices. I., SIAM J. Numer. Anal., 34 (1997), 1640-1657.  doi: 10.1137/S0036142993295545.

Figure 4.  Controls computed by the method of section 3.2 with $ s = 5 $ and $ n = 20 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 1.  The control functions using implicit Euler method computed with AMPL interfaced with IPOPTS with $ N = 10000 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  The control function computed by ICLOCS with $ N = 10000 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  The control function computed by GPOPS with $ N = 40 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Control computed by the method of section 3.2 with $ s = 4 $ and $ n = 14 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  States computed by the method of section 3.2 with $ s = 4 $ and $ n = 20 $
Figure Options

Download full-size image

Download as PowerPoint slide

Table 1.  AUV's Problem: computed values of switching times and performance index for $ s = 4 $ and various values of $ n $
$ n $ $ t_1 $ $ t_2 $ $ t_3 $ $ t_4 $ $ t_f $
6 0.049341739 0.6454231790 14.626412022 14.72348234 14.956410213
8 0.049051513 0.6456145668 14.623890223 14.72412511 14.950131513
10 0.049052155 0.6456134127 14.623817123 14.72416201 14.950161798
12 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
14 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
Table Options

Download as excel

$ n $ $ t_1 $ $ t_2 $ $ t_3 $ $ t_4 $ $ t_f $
6 0.049341739 0.6454231790 14.626412022 14.72348234 14.956410213
8 0.049051513 0.6456145668 14.623890223 14.72412511 14.950131513
10 0.049052155 0.6456134127 14.623817123 14.72416201 14.950161798
12 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
14 0.049052100 0.6456134114 14.623817653 14.72416210 14.950161782
Table 2.  Comparing results for AUV's problem with no initial guess
$ \text{Methods} $ $ N $ $ t_i $ $ \mathcal{J} $ $ \text{Iter} $ $ \text{CPU Time} $
$ \text{Euler} $ 1000 $ \text{Not available explicitly} $ 14.941407 180 1809.557
$ \text{ICLOCS} $ 1000 $ \text{Not available explicitly} $ 14.943225 1075 20.265
$ \text{GPOPS} $ 80 $ \text{Not available explicitly} $ 14.949946 20682 1027.5
Section 3.2 14 Explicitly available 14.950161 6 4.472
Table Options

Download as excel

$ \text{Methods} $ $ N $ $ t_i $ $ \mathcal{J} $ $ \text{Iter} $ $ \text{CPU Time} $
$ \text{Euler} $ 1000 $ \text{Not available explicitly} $ 14.941407 180 1809.557
$ \text{ICLOCS} $ 1000 $ \text{Not available explicitly} $ 14.943225 1075 20.265
$ \text{GPOPS} $ 80 $ \text{Not available explicitly} $ 14.949946 20682 1027.5
Section 3.2 14 Explicitly available 14.950161 6 4.472
[1]

Ying Hu, Shanjian Tang. Mixed deterministic and random optimal control of linear stochastic systems with quadratic costs. Probability, Uncertainty and Quantitative Risk, 2019, 4 (0) : 1-. doi: 10.1186/s41546-018-0035-x
[2]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control and Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487
[3]

Maria do Rosário de Pinho, Ilya Shvartsman. Lipschitz continuity of optimal control and Lagrange multipliers in a problem with mixed and pure state constraints. Discrete and Continuous Dynamical Systems, 2011, 29 (2) : 505-522. doi: 10.3934/dcds.2011.29.505
[4]

Georg Vossen, Torsten Hermanns. On an optimal control problem in laser cutting with mixed finite-/infinite-dimensional constraints. Journal of Industrial and Management Optimization, 2014, 10 (2) : 503-519. doi: 10.3934/jimo.2014.10.503
[5]

Kareem T. Elgindy. Optimal control of a parabolic distributed parameter system using a fully exponentially convergent barycentric shifted gegenbauer integral pseudospectral method. Journal of Industrial and Management Optimization, 2018, 14 (2) : 473-496. doi: 10.3934/jimo.2017056
[6]

Hamid Reza Marzban, Hamid Reza Tabrizidooz. Solution of nonlinear delay optimal control problems using a composite pseudospectral collocation method. Communications on Pure and Applied Analysis, 2010, 9 (5) : 1379-1389. doi: 10.3934/cpaa.2010.9.1379
[7]

Vladimir Gaitsgory, Alex Parkinson, Ilya Shvartsman. Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time. Discrete and Continuous Dynamical Systems - B, 2019, 24 (4) : 1743-1767. doi: 10.3934/dcdsb.2018235
[8]

Fabio Bagagiolo. An infinite horizon optimal control problem for some switching systems. Discrete and Continuous Dynamical Systems - B, 2001, 1 (4) : 443-462. doi: 10.3934/dcdsb.2001.1.443
[9]

Zhen-Zhen Tao, Bing Sun. Galerkin spectral method for elliptic optimal control problem with $L^2$-norm control constraint. Discrete and Continuous Dynamical Systems - B, 2022, 27 (8) : 4121-4141. doi: 10.3934/dcdsb.2021220
[10]

Hang-Chin Lai, Jin-Chirng Lee, Shuh-Jye Chern. A variational problem and optimal control. Journal of Industrial and Management Optimization, 2011, 7 (4) : 967-975. doi: 10.3934/jimo.2011.7.967
[11]

Eduardo Casas, Fredi Tröltzsch. Sparse optimal control for the heat equation with mixed control-state constraints. Mathematical Control and Related Fields, 2020, 10 (3) : 471-491. doi: 10.3934/mcrf.2020007
[12]

Jean-Daniel Djida, Gisèle Mophou, Mahamadi Warma. Optimal control of mixed local-nonlocal parabolic PDE with singular boundary-exterior data. Evolution Equations and Control Theory, 2022  doi: 10.3934/eect.2022015
[13]

John T. Betts, Stephen Campbell, Claire Digirolamo. Examination of solving optimal control problems with delays using GPOPS-Ⅱ. Numerical Algebra, Control and Optimization, 2021, 11 (2) : 283-305. doi: 10.3934/naco.2020026
[14]

Mohamed Aliane, Mohand Bentobache, Nacima Moussouni, Philippe Marthon. Direct method to solve linear-quadratic optimal control problems. Numerical Algebra, Control and Optimization, 2021, 11 (4) : 645-663. doi: 10.3934/naco.2021002
[15]

Tianliang Hou, Yanping Chen. Superconvergence for elliptic optimal control problems discretized by RT1 mixed finite elements and linear discontinuous elements. Journal of Industrial and Management Optimization, 2013, 9 (3) : 631-642. doi: 10.3934/jimo.2013.9.631
[16]

Yi Cui, Xintong Fang, Gaoqi Liu, Bin Li. Trajectory optimization of UAV based on Hp-adaptive Radau pseudospectral method. Journal of Industrial and Management Optimization, 2021  doi: 10.3934/jimo.2021201
[17]

Qun Lin, Ryan Loxton, Kok Lay Teo. The control parameterization method for nonlinear optimal control: A survey. Journal of Industrial and Management Optimization, 2014, 10 (1) : 275-309. doi: 10.3934/jimo.2014.10.275
[18]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control and Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[19]

Huaiqiang Yu, Bin Liu. Pontryagin's principle for local solutions of optimal control governed by the 2D Navier-Stokes equations with mixed control-state constraints. Mathematical Control and Related Fields, 2012, 2 (1) : 61-80. doi: 10.3934/mcrf.2012.2.61
[20]

Térence Bayen, Marc Mazade, Francis Mairet. Analysis of an optimal control problem connected to bioprocesses involving a saturated singular arc. Discrete and Continuous Dynamical Systems - B, 2015, 20 (1) : 39-58. doi: 10.3934/dcdsb.2015.20.39

2021 Impact Factor: 1.497

Tools

Metrics

  • PDF downloads (407)
  • HTML views (133)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy