2016, 6(3): 339-364. doi: 10.3934/naco.2016016

A new computational strategy for optimal control problem with a cost on changing control

1. 

Department of Mathematics and Statistics, Curtin University, Perth, Australia, Australia

2. 

Department of Mathematics , Shanghai University, Shanghai, China

Received  April 2015 Revised  September 2016 Published  September 2016

In this paper, we consider a class of optimal control problems where the cost function is the sum of the terminal cost, the integral cost and the full variation of control. Here, the full variation of a control is defined as the sum of the total variations of its components. By using the control parameterization technique in conjunction with the time scaling transformation, we develop a new computational algorithm for solving this type of optimal control problem. Rigorous convergence analysis is provided for the new method. For illustration, we solve two numerical examples to show the effectiveness of the proposed method.
Citation: Yujing Wang, Changjun Yu, Kok Lay Teo. A new computational strategy for optimal control problem with a cost on changing control. Numerical Algebra, Control & Optimization, 2016, 6 (3) : 339-364. doi: 10.3934/naco.2016016
References:
[1]

B. Açikmeşe and L. Blackmore, Lossless convexification of a class of nonconvex optimal control problems for linear systems,, In Proceedings of the 2010 American control conference, (2010).

[2]

B. Açikmeşe and L. Blackmore, Lossless convexification of a class of optimal control problems with non-convex control constraints,, Automatica, 47 (2011), 341. doi: 10.1016/j.automatica.2010.10.037.

[3]

N. U. Ahmed, Elements of Finite-Dimensional Systems and Control Theory,, Essex: Longman Scientific and Technical, (1988).

[4]

N. U. Ahmed, Dynamic Systems and Control with Applications,, Singapore: World Scientific, (2006). doi: 10.1142/6262.

[5]

J. M. Blatt, Optimal control with a cost of switching control,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 19 (1976), 316.

[6]

N. Banihashemi and C. Y. Kaya, Inexact restoration and adaptive mesh refinement for optimal control,, Journal of Industrial and Management Optimization, 10 (2014), 521. doi: 10.3934/jimo.2014.10.521.

[7]

C. Büskens and H. Maurer, SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis, and real-time control,, Journal of Computational and Applied Mathematics, 120 (2000), 85. doi: 10.1016/S0377-0427(00)00305-8.

[8]

W. N. Chen, J. Zhang, H. S. H. Chung, W. L. Zhong, W. G. Wu and Y. H. Shi, A novel set-based particle swarm optimization method for discrete optimization problems,, IEEE Transactions on Evolutionary Computation, 14 (2010), 278.

[9]

M. Gerdts, Global convergence of a non-smooth Newton method for control-state constrained optimal control problems,, SIAM Journal on Optimization, 19 (2008), 326. doi: 10.1137/060657546.

[10]

M. Gerdts and M. Kunkel, A non-smooth Newton's method for discretized optimal control problems with state and control constraints,, Journal of Industrial and Management Optimization, 4 (2008), 247. doi: 10.3934/jimo.2008.4.247.

[11]

R. F. Hartl, S. P. Sethi and R. G. Vickson, A survey of the maximum principles for optimal control problems with state constraints,, SIAM Review, 37 (1995), 181. doi: 10.1137/1037043.

[12]

L. S. Jennings, M. E. Fisher, K. L. Teo and C. J. Goh, MISER 3 Optimal Control Software: Theory and User Manual,, version 3. University of Western Australia, (2004).

[13]

L. S. Jennings and K. L. Teo, A numerical algorithm for constrained optimal control problems with applications to harvesting,, in, (1990), 218. doi: 10.1007/978-1-4684-6784-0_12.

[14]

C. H. Jiang, Q. Lin, C. J. Yu, K. L. Teo and G. R. Duan, An exact penalty method for free terminal time optimal control problem with continuous inequality constraints,, Journal of Optimization Theory and Applications, 154 (2012), 30. doi: 10.1007/s10957-012-0006-9.

[15]

C. Y. Kaya and J. L. Noakes, Computational method for time-optimal switching control,, Journal of Optimization Theory and Applications, 117 (2003), 69. doi: 10.1023/A:1023600422807.

[16]

H. W. J. Lee, K. L. Teo, V. Rehbock and L. S. Jennings, Control parametrization enhancing technique for time optimal control problems,, Dynamic Systems and Applications, 6 (1997), 243.

[17]

Q. Lin, R. Loxton, K. L. Teo and Y. H. Wu, A new computational method for a class of free terminal time optimal control problems,, Pacific Journal of Optimization, 7 (2011), 63.

[18]

B. Li, C. Xu, K. L. Teo and J. Chu, Time optimal Zermelo's navigation problem with moving and fixed obstacles,, Applied Mathematics and Computation, 224 (2013), 866. doi: 10.1016/j.amc.2013.08.092.

[19]

Q. Lin, R. Loxton and K. L. Teo, The control parameterization method for nonlinear optimal control: a survey,, Journal of Industrial and Management Optimization, 10 (2014), 275. doi: 10.3934/jimo.2014.10.275.

[20]

R. Loxton, Q. Lin, V. Rehbock and K. L. Teo, Control parameterization for optimal control problems with continuous inequality constraints: new convergence results., Numerical Algebra, 2 (2012), 571. doi: 10.3934/naco.2012.2.571.

[21]

R. Loxton, K. L. Teo and V. Rehbock, Optimal control problems with multiple characteristic time points in the objective and constraints,, Automatica, 44 (2008), 2923. doi: 10.1016/j.automatica.2008.04.011.

[22]

R. Loxton, K. L. Teo, V. Rehbock and K. F. C. Yiu, Optimal control problems with a continuous inequality constraint on the state and the control,, Automatica, 45 (2009), 2250. doi: 10.1016/j.automatica.2009.05.029.

[23]

D. G. Luenberger and Y. Y. Ye, Linear and Nonlinear Programming,, (3rd ed.). New York: Springer, (2008).

[24]

J. Matula, On an extremum problem,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 28 (1987), 376. doi: 10.1017/S0334270000005464.

[25]

J. Nocedal and S. J. Wright, Numerical Optimization,, (2nd ed.). New York: Springer, (2006).

[26]

H. L. Royden and P. M. Fitzpatrick, Real analysis,, (4th ed.). Boston: Prentice Hall, (2010).

[27]

Y. Sakawa and Y. Shindo, Optimal control of container cranes,, Automatica, 18 (1982), 257.

[28]

K. Schittkowski, NLPQLP: a fortran implementation of a sequential quadratic programming algorithm with distributed and non-monotone line search,, version 2.24. University of Bayreuth, (2007).

[29]

D. E. Stewart, A numerical algorithm for optimal control problems with switching costs,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 34 (1992), 212. doi: 10.1017/S0334270000008730.

[30]

K. L. Teo and C. J. Goh, On constrained optimization problems with non-smooth cost functions,, Applied Mathematics and Optimization, 17 (1988), 181. doi: 10.1007/BF01443621.

[31]

K. L. Teo, C. J. Goh and K. H. Wong, A Unified Computational Approach to Optimal Control Problems,, Essex: Longman Scientific and Technical, (1991).

[32]

K. L. Teo and L. S. Jennings, Optimal control with a cost on changing control,, Journal of Optimization Theory and Applications, 68 (1991), 335. doi: 10.1007/BF00941572.

[33]

R. J. Vanderbei, Case studies in trajectory optimization: trains, planes, and other pastimes,, Optimization and Engineering, 2 (2001), 215. doi: 10.1023/A:1013145328012.

[34]

T. L. Vincent and W. J. Grantham, Optimality in Parametric Systems,, New York: John Wiley, (1981).

[35]

L. Y. Wang, W. H. Gui, K. L. Teo, R. Loxton and C. H. Yang, Time delayed optimal control problems with multiple characteristic time points: computation and industrial applications,, Journal of Industrial and Management Optimization, 5 (2009), 705. doi: 10.3934/jimo.2009.5.705.

[36]

Z. Y. Wu, F. S. Bai, H. W. J. Lee and Y. J. Yang, A filled function method for constrained global optimization,, Journal of Global Optimization, 39 (2007), 495. doi: 10.1007/s10898-007-9152-2.

[37]

X. Xu and P. J. Antsaklis, Optimal control of switched systems based on parameterization of the switching instants,, IEEE Transactions on Automatic Control, 49 (2004), 2. doi: 10.1109/TAC.2003.821417.

[38]

C. J. Yu, B. Li, R. Loxton and K. L. Teo, Optimal discrete-valued control computation,, Journal of Global Optimization, 56 (2013), 503. doi: 10.1007/s10898-012-9858-7.

[39]

C. J. Yu, K. L. Teo , L. S. Zhang and Y. Q. Bai, A new exact penalty function method for continuous inequality constrained optimization problems,, Journal of Industrial and Management Optimization, 6 (2010), 895. doi: 10.3934/jimo.2010.6.895.

[40]

C. J. Yu, K. L. Teo and T. T. Tiow, Optimal control with a cost of changing control,, Australian Control Conference (AUCC), (2013), 20.

[41]

C. J. Yu, K. L. Teo, L. S. Zhang and Y. Q. Bai, On a refinement of the convergence analysis for the new exact penalty function method for continuous inequality constrained optimization problem,, Journal of Industrial Management and Optimization, 8 (2012), 485. doi: 10.3934/jimo.2012.8.485.

[42]

F. Yang, K. L. Teo, R. Loxton, V. Rehbock, B. Li , C. J. Yu and L. Jennings, Visual MISER: An efficient user-friendly visual program for solving optimal control problems,, Journal of Industrial and Management Optimization, (2016). doi: 10.3934/jimo.2016.12.781.

[43]

Y. Zhao and M. A. Stadtherr, Rigorous global optimization for dynamic systems subject to inequality path constraints,, Industrial and Engineering Chemistry Research, 50 (2011), 12678.

show all references

References:
[1]

B. Açikmeşe and L. Blackmore, Lossless convexification of a class of nonconvex optimal control problems for linear systems,, In Proceedings of the 2010 American control conference, (2010).

[2]

B. Açikmeşe and L. Blackmore, Lossless convexification of a class of optimal control problems with non-convex control constraints,, Automatica, 47 (2011), 341. doi: 10.1016/j.automatica.2010.10.037.

[3]

N. U. Ahmed, Elements of Finite-Dimensional Systems and Control Theory,, Essex: Longman Scientific and Technical, (1988).

[4]

N. U. Ahmed, Dynamic Systems and Control with Applications,, Singapore: World Scientific, (2006). doi: 10.1142/6262.

[5]

J. M. Blatt, Optimal control with a cost of switching control,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 19 (1976), 316.

[6]

N. Banihashemi and C. Y. Kaya, Inexact restoration and adaptive mesh refinement for optimal control,, Journal of Industrial and Management Optimization, 10 (2014), 521. doi: 10.3934/jimo.2014.10.521.

[7]

C. Büskens and H. Maurer, SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis, and real-time control,, Journal of Computational and Applied Mathematics, 120 (2000), 85. doi: 10.1016/S0377-0427(00)00305-8.

[8]

W. N. Chen, J. Zhang, H. S. H. Chung, W. L. Zhong, W. G. Wu and Y. H. Shi, A novel set-based particle swarm optimization method for discrete optimization problems,, IEEE Transactions on Evolutionary Computation, 14 (2010), 278.

[9]

M. Gerdts, Global convergence of a non-smooth Newton method for control-state constrained optimal control problems,, SIAM Journal on Optimization, 19 (2008), 326. doi: 10.1137/060657546.

[10]

M. Gerdts and M. Kunkel, A non-smooth Newton's method for discretized optimal control problems with state and control constraints,, Journal of Industrial and Management Optimization, 4 (2008), 247. doi: 10.3934/jimo.2008.4.247.

[11]

R. F. Hartl, S. P. Sethi and R. G. Vickson, A survey of the maximum principles for optimal control problems with state constraints,, SIAM Review, 37 (1995), 181. doi: 10.1137/1037043.

[12]

L. S. Jennings, M. E. Fisher, K. L. Teo and C. J. Goh, MISER 3 Optimal Control Software: Theory and User Manual,, version 3. University of Western Australia, (2004).

[13]

L. S. Jennings and K. L. Teo, A numerical algorithm for constrained optimal control problems with applications to harvesting,, in, (1990), 218. doi: 10.1007/978-1-4684-6784-0_12.

[14]

C. H. Jiang, Q. Lin, C. J. Yu, K. L. Teo and G. R. Duan, An exact penalty method for free terminal time optimal control problem with continuous inequality constraints,, Journal of Optimization Theory and Applications, 154 (2012), 30. doi: 10.1007/s10957-012-0006-9.

[15]

C. Y. Kaya and J. L. Noakes, Computational method for time-optimal switching control,, Journal of Optimization Theory and Applications, 117 (2003), 69. doi: 10.1023/A:1023600422807.

[16]

H. W. J. Lee, K. L. Teo, V. Rehbock and L. S. Jennings, Control parametrization enhancing technique for time optimal control problems,, Dynamic Systems and Applications, 6 (1997), 243.

[17]

Q. Lin, R. Loxton, K. L. Teo and Y. H. Wu, A new computational method for a class of free terminal time optimal control problems,, Pacific Journal of Optimization, 7 (2011), 63.

[18]

B. Li, C. Xu, K. L. Teo and J. Chu, Time optimal Zermelo's navigation problem with moving and fixed obstacles,, Applied Mathematics and Computation, 224 (2013), 866. doi: 10.1016/j.amc.2013.08.092.

[19]

Q. Lin, R. Loxton and K. L. Teo, The control parameterization method for nonlinear optimal control: a survey,, Journal of Industrial and Management Optimization, 10 (2014), 275. doi: 10.3934/jimo.2014.10.275.

[20]

R. Loxton, Q. Lin, V. Rehbock and K. L. Teo, Control parameterization for optimal control problems with continuous inequality constraints: new convergence results., Numerical Algebra, 2 (2012), 571. doi: 10.3934/naco.2012.2.571.

[21]

R. Loxton, K. L. Teo and V. Rehbock, Optimal control problems with multiple characteristic time points in the objective and constraints,, Automatica, 44 (2008), 2923. doi: 10.1016/j.automatica.2008.04.011.

[22]

R. Loxton, K. L. Teo, V. Rehbock and K. F. C. Yiu, Optimal control problems with a continuous inequality constraint on the state and the control,, Automatica, 45 (2009), 2250. doi: 10.1016/j.automatica.2009.05.029.

[23]

D. G. Luenberger and Y. Y. Ye, Linear and Nonlinear Programming,, (3rd ed.). New York: Springer, (2008).

[24]

J. Matula, On an extremum problem,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 28 (1987), 376. doi: 10.1017/S0334270000005464.

[25]

J. Nocedal and S. J. Wright, Numerical Optimization,, (2nd ed.). New York: Springer, (2006).

[26]

H. L. Royden and P. M. Fitzpatrick, Real analysis,, (4th ed.). Boston: Prentice Hall, (2010).

[27]

Y. Sakawa and Y. Shindo, Optimal control of container cranes,, Automatica, 18 (1982), 257.

[28]

K. Schittkowski, NLPQLP: a fortran implementation of a sequential quadratic programming algorithm with distributed and non-monotone line search,, version 2.24. University of Bayreuth, (2007).

[29]

D. E. Stewart, A numerical algorithm for optimal control problems with switching costs,, Journal of the Australian Mathematical Society-Series B: Applied Mathematics, 34 (1992), 212. doi: 10.1017/S0334270000008730.

[30]

K. L. Teo and C. J. Goh, On constrained optimization problems with non-smooth cost functions,, Applied Mathematics and Optimization, 17 (1988), 181. doi: 10.1007/BF01443621.

[31]

K. L. Teo, C. J. Goh and K. H. Wong, A Unified Computational Approach to Optimal Control Problems,, Essex: Longman Scientific and Technical, (1991).

[32]

K. L. Teo and L. S. Jennings, Optimal control with a cost on changing control,, Journal of Optimization Theory and Applications, 68 (1991), 335. doi: 10.1007/BF00941572.

[33]

R. J. Vanderbei, Case studies in trajectory optimization: trains, planes, and other pastimes,, Optimization and Engineering, 2 (2001), 215. doi: 10.1023/A:1013145328012.

[34]

T. L. Vincent and W. J. Grantham, Optimality in Parametric Systems,, New York: John Wiley, (1981).

[35]

L. Y. Wang, W. H. Gui, K. L. Teo, R. Loxton and C. H. Yang, Time delayed optimal control problems with multiple characteristic time points: computation and industrial applications,, Journal of Industrial and Management Optimization, 5 (2009), 705. doi: 10.3934/jimo.2009.5.705.

[36]

Z. Y. Wu, F. S. Bai, H. W. J. Lee and Y. J. Yang, A filled function method for constrained global optimization,, Journal of Global Optimization, 39 (2007), 495. doi: 10.1007/s10898-007-9152-2.

[37]

X. Xu and P. J. Antsaklis, Optimal control of switched systems based on parameterization of the switching instants,, IEEE Transactions on Automatic Control, 49 (2004), 2. doi: 10.1109/TAC.2003.821417.

[38]

C. J. Yu, B. Li, R. Loxton and K. L. Teo, Optimal discrete-valued control computation,, Journal of Global Optimization, 56 (2013), 503. doi: 10.1007/s10898-012-9858-7.

[39]

C. J. Yu, K. L. Teo , L. S. Zhang and Y. Q. Bai, A new exact penalty function method for continuous inequality constrained optimization problems,, Journal of Industrial and Management Optimization, 6 (2010), 895. doi: 10.3934/jimo.2010.6.895.

[40]

C. J. Yu, K. L. Teo and T. T. Tiow, Optimal control with a cost of changing control,, Australian Control Conference (AUCC), (2013), 20.

[41]

C. J. Yu, K. L. Teo, L. S. Zhang and Y. Q. Bai, On a refinement of the convergence analysis for the new exact penalty function method for continuous inequality constrained optimization problem,, Journal of Industrial Management and Optimization, 8 (2012), 485. doi: 10.3934/jimo.2012.8.485.

[42]

F. Yang, K. L. Teo, R. Loxton, V. Rehbock, B. Li , C. J. Yu and L. Jennings, Visual MISER: An efficient user-friendly visual program for solving optimal control problems,, Journal of Industrial and Management Optimization, (2016). doi: 10.3934/jimo.2016.12.781.

[43]

Y. Zhao and M. A. Stadtherr, Rigorous global optimization for dynamic systems subject to inequality path constraints,, Industrial and Engineering Chemistry Research, 50 (2011), 12678.

[1]

Takeshi Ohtsuka, Ken Shirakawa, Noriaki Yamazaki. Optimal control problem for Allen-Cahn type equation associated with total variation energy. Discrete & Continuous Dynamical Systems - S, 2012, 5 (1) : 159-181. doi: 10.3934/dcdss.2012.5.159

[2]

Matthias Gerdts, Martin Kunkel. Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation. Journal of Industrial & Management Optimization, 2014, 10 (1) : 311-336. doi: 10.3934/jimo.2014.10.311

[3]

Hang-Chin Lai, Jin-Chirng Lee, Shuh-Jye Chern. A variational problem and optimal control. Journal of Industrial & Management Optimization, 2011, 7 (4) : 967-975. doi: 10.3934/jimo.2011.7.967

[4]

Giulia Cavagnari. Regularity results for a time-optimal control problem in the space of probability measures. Mathematical Control & Related Fields, 2017, 7 (2) : 213-233. doi: 10.3934/mcrf.2017007

[5]

Jingtao Shi, Juanjuan Xu, Huanshui Zhang. Stochastic recursive optimal control problem with time delay and applications. Mathematical Control & Related Fields, 2015, 5 (4) : 859-888. doi: 10.3934/mcrf.2015.5.859

[6]

Jiongmin Yong. A deterministic linear quadratic time-inconsistent optimal control problem. Mathematical Control & Related Fields, 2011, 1 (1) : 83-118. doi: 10.3934/mcrf.2011.1.83

[7]

Sören Bartels, Marijo Milicevic. Iterative finite element solution of a constrained total variation regularized model problem. Discrete & Continuous Dynamical Systems - S, 2017, 10 (6) : 1207-1232. doi: 10.3934/dcdss.2017066

[8]

Florian Krügel. Some properties of minimizers of a variational problem involving the total variation functional. Communications on Pure & Applied Analysis, 2015, 14 (1) : 341-360. doi: 10.3934/cpaa.2015.14.341

[9]

Konstantinos Papafitsoros, Kristian Bredies. A study of the one dimensional total generalised variation regularisation problem. Inverse Problems & Imaging, 2015, 9 (2) : 511-550. doi: 10.3934/ipi.2015.9.511

[10]

Ellina Grigorieva, Evgenii Khailov, Andrei Korobeinikov. An optimal control problem in HIV treatment. Conference Publications, 2013, 2013 (special) : 311-322. doi: 10.3934/proc.2013.2013.311

[11]

Xiaoqun Zhang, Tony F. Chan. Wavelet inpainting by nonlocal total variation. Inverse Problems & Imaging, 2010, 4 (1) : 191-210. doi: 10.3934/ipi.2010.4.191

[12]

Ellina Grigorieva, Evgenii Khailov, Andrei Korobeinikov. Parametrization of the attainable set for a nonlinear control model of a biochemical process. Mathematical Biosciences & Engineering, 2013, 10 (4) : 1067-1094. doi: 10.3934/mbe.2013.10.1067

[13]

Alexander Arguchintsev, Vasilisa Poplevko. An optimal control problem by parabolic equation with boundary smooth control and an integral constraint. Numerical Algebra, Control & Optimization, 2018, 8 (2) : 193-202. doi: 10.3934/naco.2018011

[14]

Piermarco Cannarsa, Cristina Pignotti, Carlo Sinestrari. Semiconcavity for optimal control problems with exit time. Discrete & Continuous Dynamical Systems - A, 2000, 6 (4) : 975-997. doi: 10.3934/dcds.2000.6.975

[15]

Jérome Lohéac, Jean-François Scheid. Time optimal control for a nonholonomic system with state constraint. Mathematical Control & Related Fields, 2013, 3 (2) : 185-208. doi: 10.3934/mcrf.2013.3.185

[16]

Piermarco Cannarsa, Carlo Sinestrari. On a class of nonlinear time optimal control problems. Discrete & Continuous Dynamical Systems - A, 1995, 1 (2) : 285-300. doi: 10.3934/dcds.1995.1.285

[17]

V.N. Malozemov, A.V. Omelchenko. On a discrete optimal control problem with an explicit solution. Journal of Industrial & Management Optimization, 2006, 2 (1) : 55-62. doi: 10.3934/jimo.2006.2.55

[18]

Urszula Ledzewicz, Heinz Schättler. Drug resistance in cancer chemotherapy as an optimal control problem. Discrete & Continuous Dynamical Systems - B, 2006, 6 (1) : 129-150. doi: 10.3934/dcdsb.2006.6.129

[19]

Rinaldo M. Colombo, Francesca Monti. Solutions with large total variation to nonconservative hyperbolic systems. Communications on Pure & Applied Analysis, 2010, 9 (1) : 47-60. doi: 10.3934/cpaa.2010.9.47

[20]

Haiyang Wang, Zhen Wu. Time-inconsistent optimal control problem with random coefficients and stochastic equilibrium HJB equation. Mathematical Control & Related Fields, 2015, 5 (3) : 651-678. doi: 10.3934/mcrf.2015.5.651

 Impact Factor: 

Metrics

  • PDF downloads (3)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]