American Institute of Mathematical Sciences

Advanced
doi: 10.3934/naco.2021005

Optimal control of a dynamical system with intermediate phase constraints and applications in cash management

Mourad Azi 1,, and  Mohand Ouamer Bibi 2,

1. 

Department of Mathematics and Computer Science, University of Mila, 043000 Mila, Algeria, Research Unit LaMOS, University of Bejaia
2. 

Research Unit LaMOS, Department of Operational Research, University of Bejaia, 06000 Bejaia, Algeria

* Corresponding author: Mourad Azi

Received  May 2020 Revised  January 2021 Published  February 2021

The aim of this work is to apply the results of R. Gabasov et al. [4,14] to an extended class of optimal control problems in the Bolza form, with intermediate phase constraints and multivariate control. In this paper, the developed iterative numerical method avoids the discretization of the dynamical system. Indeed, by using a piecewise constant control, the problem is reduced for each iteration to a linear programming problem, this auxiliary task allows to improve the value of the quality criterion. The process is repeated until the optimal or the suboptimal control is obtained. As an application, we use this method to solve an extension of the deterministic optimal cash management model of S.P. Sethi [31,32]. In this extension, we assume that the bank overdrafts and short selling of stock are allowed, but within the authorized time limit. The results of the numerical example show that the optimal decision for the firm depends closely on the intermediate moment, the optimal decision for the firm is to purchase until a certain date the stocks at their authorized maximum value in order to take advantage of the returns derived from stock. After that, it sales the stocks at their authorized maximum value in order to satisfy the constraint at the intermediate moment.

Keywords: Optimal Control, Bolza Problem, Intermediate Phase Constraints, Support Problem, Cash Management.
Mathematics Subject Classification: Primary: 49N05, 91G50; Secondary: 49M05.
Citation: Mourad Azi, Mohand Ouamer Bibi. Optimal control of a dynamical system with intermediate phase constraints and applications in cash management. Numerical Algebra, Control & Optimization, doi: 10.3934/naco.2021005
References:
[1]

A. V. Arutyunov and A. I. Okoulevitch, Necessary optimality conditions for optimal control problems with itermediate constraints, Journal of Dynamical and Control Systems, 4 (1998), 49-58.  doi: 10.2307/2152750.  Google Scholar

[2]

M. Azi and M. O. Bibi, Optimal cash management with intermediate phase constraints, In Proc. of the International Conference on Financial mathematics Tools and Applications (MFOA'2019) University of Bejaia, Octobre 28-29, (2019), 14 – 23. doi: 10.2307/2152750.  Google Scholar

[3]

M. Azi and M. O. Bibi, Optimal Control of Linear Dynamical System with Intermediate Phase Constraints, In Proc. of the 11th Conference on the Optimization and Information Systems, (COSI'2014), (2014), 347–356. doi: 10.2307/2152750.  Google Scholar

[4]

N. V. Balashevich, R. Gabasov and F. M. Kirillova, Algorithms for open loop and closed loop optimization of control systems with intermediate phase constraints, Zh. Vychisl. Mat. Fiz, 41 (2001), 1485-1504.  doi: 10.2307/2152750.  Google Scholar

[5]

M. O. Bibi, Methods for Solving Linear-Quadratic Problems of Optimal Control, Ph.D Thesis, University of Minsk, 1985. Google Scholar

[6]

M. O. Bibi, Optimization of a linear dynamic system with double terminal constraint on the trajectories, Optimization, 30 (1994), 359-366.  doi: 10.2307/2152750.  Google Scholar

[7]

M. O. Bibi, Support method for solving a linear-quadratic problem with polyhedral constraints on control, Optimization, 37 (1996), 139-147.  doi: 10.2307/2152750.  Google Scholar

[8]

M. O. Bibi and M. Bentobache, A hybrid direction algorithm for solving linear programs, International Journal of Computer Mathematics, 92 (2015), 201-216.  doi: 10.2307/2152750.  Google Scholar

[9]

M. O. Bibi and S. Medjdoub, Optimal control of a linear-quadratic problem with free initial condition, In Proc. 26th European conference on operational research, Rome, Italy, (2013), 362–362. doi: 10.2307/2152750.  Google Scholar

[10]

T. Bjork, M. H. A. Davis and C. Landen, Optimal investment under partial information, Mathematical Methods of Operations Research, 71 (2010), 371-399.  doi: 10.2307/2152750.  Google Scholar

[11]

W. J. Baumol, The transactions demand for cash: An inventory theoretic approach, Quarterly Journal of Economics, 66 (1952), 545-556.  doi: 10.2307/2152750.  Google Scholar

[12]

M. N. Dmitruk and R. Gabasov, The optimal policy of dividends, investments, and capital distribution for the dynamic model of a company, Automation and Remote Control, 62 (2001), 1349-1365.  doi: 10.2307/2152750.  Google Scholar

[13]

A. V. Dmitruk and A. M. Kaganovich, Maximum principle for optimal control problems with intermediate constraints, Computational Mathematics and Modeling, 22 (2011), 180-215.  doi: 10.2307/2152750.  Google Scholar

[14]

L. D. Erovenko, Algorithm for optimization of a non-stationary dynamic system, in Constructive Theory of Extremal Problems (eds. R. Gabasov and F.M. Kirillova), University Press, Minsk, (1984), 76–89.  Google Scholar

[15]

R. Gabasov, N. V. Balashevich and F. M. Kirillova, Constructive methods of optimization of dynamical systems, Vietnam Journal of Mathematics, 30 (2002), 201-239.  doi: 10.2307/2152750.  Google Scholar

[16]

R. Gabasov, M. N. Dmitruk and F. M. Kirillova, Optimization of the multidimensional control systems with parallelepiped constraints, Automation and Remote Control, 63 (2002), 345-366.  doi: 10.2307/2152750.  Google Scholar

[17]

R. Gabasov, O. P. Grushevich and F. M. Kirillova, Optimal control of the delay linear systems with allowance for the terminal state constraints, Automation and Remote Control, 68 (2007), 2097-2112.  doi: 10.2307/2152750.  Google Scholar

[18] R. Gabasov, F. M. Kirillova and A. I. Tyatyushkin, Constructive Methods of Optimization, P.Ⅰ: Linear Problems, University Press, Minsk, 1984.  doi: 10.1007/978-1-4612-0873-0.  Google Scholar
[19] R. Gabasov and F. M. Kirillova, Constructive Methods of Optimization, P.Ⅱ: Control Problems, University Press, Minsk, 1984.  doi: 10.1007/978-1-4612-0873-0.  Google Scholar
[20]

R. Gabasov, F. M. Kirillova, V. V. Alsevich, A. I. Kalinin, V. V. Krakhotko and N. S. Pavlenko, Methods of Optimization, Four Quarters, Minsk, 2011. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[21]

R. Gabasov, F. M. Kirillova and N. S. Pavlenok, Constructing open-loop and closed-loop solutions of linear-quadratic optimal control problems, Computational Mathematics and Mathematical Physics, 48 (2008), 1715-1745. doi: 10.2307/2152750.  Google Scholar

[22]

R. Gabasov, F. M. Kirillova and S. V. Prischepova, Optimal Feedback Control, Springer-Verlag, London, 1995. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[23]

F. Ghellab and M. O. Bibi, Optimality and suboptimality criteria in a quadratic problem of optimal control with a piecewise linear entry, International Journal of Mathematics in Operational Research, 2020. doi: 10.2307/2152750.  Google Scholar

[24]

O. Hilton, P. M. Kort and P. J. J. M. Loon, Dynamic Policies of a Firm: An Optimal Control Approach, Springer, Berlin, 1993. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[25]

N. Khimoum and M. O. Bibi, Primal-dual method for solving a linear-quadratic multi-input optimal control problem, Optimization Letters, 14 (2020), 653-669.  doi: 10.2307/2152750.  Google Scholar

[26]

R. Korn, Some applications of impulse control in mathematical finance, Mathematical Methods of Operations Research, 50 (1999), 493-518.  doi: 10.2307/2152750.  Google Scholar

[27]

K. Li, E. Feng and Z. Xiu, Optimal control and optimization algorithm of nonlinear impulsive delay system producing 1, 3-Propanediol, Journal of Applied Mathematics and Computing, 24 (2007), 387-397.  doi: 10.2307/2152750.  Google Scholar

[28]

W. I. Nathanson, Control Problems with intermediate constraints: A sufficient condition, Journal of Optimization Theory and Applications, 29 (1979), 253-290.  doi: 10.2307/2152750.  Google Scholar

[29]

W. I. Nathanson, Control problems with intermediate constraints, Journal of Optimization Theory and Applications, 8 (1971), 256-270.  doi: 10.2307/2152750.  Google Scholar

[30]

L. S. Pontryaguine, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, John Wiley and Sons, New Jersey, 1962. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[31]

S. P. Sethi, A. Bensoussan and A. Chutani, Optimal cash management under uncertainty, Operations Research Letters, 37 (2009), 425-429.  doi: 10.2307/2152750.  Google Scholar

[32]

S. P. Sethi, Optimal Control Theory: Applications to Management Sciences and Economics, Third edition, Springer Nature Switzerland, 2019. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[33]

S. P. Sethi and Q. Zhang, Systems and Control: Foundations and Applications, Birkhauser Boston, 1994. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

show all references

References:
[1]

A. V. Arutyunov and A. I. Okoulevitch, Necessary optimality conditions for optimal control problems with itermediate constraints, Journal of Dynamical and Control Systems, 4 (1998), 49-58.  doi: 10.2307/2152750.  Google Scholar

[2]

M. Azi and M. O. Bibi, Optimal cash management with intermediate phase constraints, In Proc. of the International Conference on Financial mathematics Tools and Applications (MFOA'2019) University of Bejaia, Octobre 28-29, (2019), 14 – 23. doi: 10.2307/2152750.  Google Scholar

[3]

M. Azi and M. O. Bibi, Optimal Control of Linear Dynamical System with Intermediate Phase Constraints, In Proc. of the 11th Conference on the Optimization and Information Systems, (COSI'2014), (2014), 347–356. doi: 10.2307/2152750.  Google Scholar

[4]

N. V. Balashevich, R. Gabasov and F. M. Kirillova, Algorithms for open loop and closed loop optimization of control systems with intermediate phase constraints, Zh. Vychisl. Mat. Fiz, 41 (2001), 1485-1504.  doi: 10.2307/2152750.  Google Scholar

[5]

M. O. Bibi, Methods for Solving Linear-Quadratic Problems of Optimal Control, Ph.D Thesis, University of Minsk, 1985. Google Scholar

[6]

M. O. Bibi, Optimization of a linear dynamic system with double terminal constraint on the trajectories, Optimization, 30 (1994), 359-366.  doi: 10.2307/2152750.  Google Scholar

[7]

M. O. Bibi, Support method for solving a linear-quadratic problem with polyhedral constraints on control, Optimization, 37 (1996), 139-147.  doi: 10.2307/2152750.  Google Scholar

[8]

M. O. Bibi and M. Bentobache, A hybrid direction algorithm for solving linear programs, International Journal of Computer Mathematics, 92 (2015), 201-216.  doi: 10.2307/2152750.  Google Scholar

[9]

M. O. Bibi and S. Medjdoub, Optimal control of a linear-quadratic problem with free initial condition, In Proc. 26th European conference on operational research, Rome, Italy, (2013), 362–362. doi: 10.2307/2152750.  Google Scholar

[10]

T. Bjork, M. H. A. Davis and C. Landen, Optimal investment under partial information, Mathematical Methods of Operations Research, 71 (2010), 371-399.  doi: 10.2307/2152750.  Google Scholar

[11]

W. J. Baumol, The transactions demand for cash: An inventory theoretic approach, Quarterly Journal of Economics, 66 (1952), 545-556.  doi: 10.2307/2152750.  Google Scholar

[12]

M. N. Dmitruk and R. Gabasov, The optimal policy of dividends, investments, and capital distribution for the dynamic model of a company, Automation and Remote Control, 62 (2001), 1349-1365.  doi: 10.2307/2152750.  Google Scholar

[13]

A. V. Dmitruk and A. M. Kaganovich, Maximum principle for optimal control problems with intermediate constraints, Computational Mathematics and Modeling, 22 (2011), 180-215.  doi: 10.2307/2152750.  Google Scholar

[14]

L. D. Erovenko, Algorithm for optimization of a non-stationary dynamic system, in Constructive Theory of Extremal Problems (eds. R. Gabasov and F.M. Kirillova), University Press, Minsk, (1984), 76–89.  Google Scholar

[15]

R. Gabasov, N. V. Balashevich and F. M. Kirillova, Constructive methods of optimization of dynamical systems, Vietnam Journal of Mathematics, 30 (2002), 201-239.  doi: 10.2307/2152750.  Google Scholar

[16]

R. Gabasov, M. N. Dmitruk and F. M. Kirillova, Optimization of the multidimensional control systems with parallelepiped constraints, Automation and Remote Control, 63 (2002), 345-366.  doi: 10.2307/2152750.  Google Scholar

[17]

R. Gabasov, O. P. Grushevich and F. M. Kirillova, Optimal control of the delay linear systems with allowance for the terminal state constraints, Automation and Remote Control, 68 (2007), 2097-2112.  doi: 10.2307/2152750.  Google Scholar

[18] R. Gabasov, F. M. Kirillova and A. I. Tyatyushkin, Constructive Methods of Optimization, P.Ⅰ: Linear Problems, University Press, Minsk, 1984.  doi: 10.1007/978-1-4612-0873-0.  Google Scholar
[19] R. Gabasov and F. M. Kirillova, Constructive Methods of Optimization, P.Ⅱ: Control Problems, University Press, Minsk, 1984.  doi: 10.1007/978-1-4612-0873-0.  Google Scholar
[20]

R. Gabasov, F. M. Kirillova, V. V. Alsevich, A. I. Kalinin, V. V. Krakhotko and N. S. Pavlenko, Methods of Optimization, Four Quarters, Minsk, 2011. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[21]

R. Gabasov, F. M. Kirillova and N. S. Pavlenok, Constructing open-loop and closed-loop solutions of linear-quadratic optimal control problems, Computational Mathematics and Mathematical Physics, 48 (2008), 1715-1745. doi: 10.2307/2152750.  Google Scholar

[22]

R. Gabasov, F. M. Kirillova and S. V. Prischepova, Optimal Feedback Control, Springer-Verlag, London, 1995. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[23]

F. Ghellab and M. O. Bibi, Optimality and suboptimality criteria in a quadratic problem of optimal control with a piecewise linear entry, International Journal of Mathematics in Operational Research, 2020. doi: 10.2307/2152750.  Google Scholar

[24]

O. Hilton, P. M. Kort and P. J. J. M. Loon, Dynamic Policies of a Firm: An Optimal Control Approach, Springer, Berlin, 1993. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[25]

N. Khimoum and M. O. Bibi, Primal-dual method for solving a linear-quadratic multi-input optimal control problem, Optimization Letters, 14 (2020), 653-669.  doi: 10.2307/2152750.  Google Scholar

[26]

R. Korn, Some applications of impulse control in mathematical finance, Mathematical Methods of Operations Research, 50 (1999), 493-518.  doi: 10.2307/2152750.  Google Scholar

[27]

K. Li, E. Feng and Z. Xiu, Optimal control and optimization algorithm of nonlinear impulsive delay system producing 1, 3-Propanediol, Journal of Applied Mathematics and Computing, 24 (2007), 387-397.  doi: 10.2307/2152750.  Google Scholar

[28]

W. I. Nathanson, Control Problems with intermediate constraints: A sufficient condition, Journal of Optimization Theory and Applications, 29 (1979), 253-290.  doi: 10.2307/2152750.  Google Scholar

[29]

W. I. Nathanson, Control problems with intermediate constraints, Journal of Optimization Theory and Applications, 8 (1971), 256-270.  doi: 10.2307/2152750.  Google Scholar

[30]

L. S. Pontryaguine, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mishchenko, The Mathematical Theory of Optimal Processes, John Wiley and Sons, New Jersey, 1962. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[31]

S. P. Sethi, A. Bensoussan and A. Chutani, Optimal cash management under uncertainty, Operations Research Letters, 37 (2009), 425-429.  doi: 10.2307/2152750.  Google Scholar

[32]

S. P. Sethi, Optimal Control Theory: Applications to Management Sciences and Economics, Third edition, Springer Nature Switzerland, 2019. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

[33]

S. P. Sethi and Q. Zhang, Systems and Control: Foundations and Applications, Birkhauser Boston, 1994. doi: 10.1007/978-1-4612-0873-0.  Google Scholar

Figure 1.  Optimal control $ u_1^*(t) $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Optimal control $ u_2^*(t) $
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Namsu Ahn, Soochan Kim. Optimal and heuristic algorithms for the multi-objective vehicle routing problem with drones for military surveillance operations. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021037
[2]

Alberto Bressan, Ke Han, Franco Rampazzo. On the control of non holonomic systems by active constraints. Discrete & Continuous Dynamical Systems - A, 2013, 33 (8) : 3329-3353. doi: 10.3934/dcds.2013.33.3329
[3]

Enkhbat Rentsen, Battur Gompil. Generalized Nash equilibrium problem based on malfatti's problem. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 209-220. doi: 10.3934/naco.2020022
[4]

Alexandr Mikhaylov, Victor Mikhaylov. Dynamic inverse problem for Jacobi matrices. Inverse Problems & Imaging, 2019, 13 (3) : 431-447. doi: 10.3934/ipi.2019021
[5]

Armin Lechleiter, Tobias Rienmüller. Factorization method for the inverse Stokes problem. Inverse Problems & Imaging, 2013, 7 (4) : 1271-1293. doi: 10.3934/ipi.2013.7.1271
[6]

Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437
[7]

Hildeberto E. Cabral, Zhihong Xia. Subharmonic solutions in the restricted three-body problem. Discrete & Continuous Dynamical Systems - A, 1995, 1 (4) : 463-474. doi: 10.3934/dcds.1995.1.463
[8]

Paula A. González-Parra, Sunmi Lee, Leticia Velázquez, Carlos Castillo-Chavez. A note on the use of optimal control on a discrete time model of influenza dynamics. Mathematical Biosciences & Engineering, 2011, 8 (1) : 183-197. doi: 10.3934/mbe.2011.8.183
[9]

Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399
[10]

Xiaohong Li, Mingxin Sun, Zhaohua Gong, Enmin Feng. Multistage optimal control for microbial fed-batch fermentation process. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021040
[11]

John T. Betts, Stephen Campbell, Claire Digirolamo. Examination of solving optimal control problems with delays using GPOPS-Ⅱ. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 283-305. doi: 10.3934/naco.2020026
[12]

Michel Chipot, Mingmin Zhang. On some model problem for the propagation of interacting species in a special environment. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020401
[13]

Fritz Gesztesy, Helge Holden, Johanna Michor, Gerald Teschl. The algebro-geometric initial value problem for the Ablowitz-Ladik hierarchy. Discrete & Continuous Dynamical Systems - A, 2010, 26 (1) : 151-196. doi: 10.3934/dcds.2010.26.151
[14]

Gloria Paoli, Gianpaolo Piscitelli, Rossanno Sannipoli. A stability result for the Steklov Laplacian Eigenvalue Problem with a spherical obstacle. Communications on Pure & Applied Analysis, 2021, 20 (1) : 145-158. doi: 10.3934/cpaa.2020261
[15]

Hailing Xuan, Xiaoliang Cheng. Numerical analysis and simulation of an adhesive contact problem with damage and long memory. Discrete & Continuous Dynamical Systems - B, 2021, 26 (5) : 2781-2804. doi: 10.3934/dcdsb.2020205
[16]

Marco Ghimenti, Anna Maria Micheletti. Compactness results for linearly perturbed Yamabe problem on manifolds with boundary. Discrete & Continuous Dynamical Systems - S, 2021, 14 (5) : 1757-1778. doi: 10.3934/dcdss.2020453
[17]

Shanjian Tang, Fu Zhang. Path-dependent optimal stochastic control and viscosity solution of associated Bellman equations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (11) : 5521-5553. doi: 10.3934/dcds.2015.35.5521
[18]

Rongchang Liu, Jiangyuan Li, Duokui Yan. New periodic orbits in the planar equal-mass three-body problem. Discrete & Continuous Dynamical Systems - A, 2018, 38 (4) : 2187-2206. doi: 10.3934/dcds.2018090
[19]

Marion Darbas, Jérémy Heleine, Stephanie Lohrengel. Numerical resolution by the quasi-reversibility method of a data completion problem for Maxwell's equations. Inverse Problems & Imaging, 2020, 14 (6) : 1107-1133. doi: 10.3934/ipi.2020056
[20]

Mohsen Abdolhosseinzadeh, Mir Mohammad Alipour. Design of experiment for tuning parameters of an ant colony optimization method for the constrained shortest Hamiltonian path problem in the grid networks. Numerical Algebra, Control & Optimization, 2021, 11 (2) : 321-332. doi: 10.3934/naco.2020028

 Impact Factor: 

Tools

Metrics

  • PDF downloads (19)
  • HTML views (42)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences