American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Rate of $L^2$-concentration of the blow-up solution for critical nonlinear Schrödinger equation with potential
  • MCRF Home
  • This Issue
  • Next Article
    Global well-posedness and asymptotic behavior of a class of initial-boundary-value problem of the Korteweg-De Vries equation on a finite domain
March  2011, 1(1): 83-118. doi: 10.3934/mcrf.2011.1.83

A deterministic linear quadratic time-inconsistent optimal control problem

Jiongmin Yong 1,

1. 

Department of Mathematics, University of Central Florida, Orlando, FL 32816

Received  October 2010 Revised  November 2010 Published  March 2011

A time-inconsistent optimal control problem is formulated and studied for a controlled linear ordinary differential equation with a quadratic cost functional. A notion of time-consistent equilibrium strategy is introduced for the original time-inconsistent problem. Under certain conditions, we construct an equilibrium strategy which can be represented via a Riccati--Volterra integral equation system. Our approach is based on a study of multi-person hierarchical differential games.
Keywords: linear-quadratic optimal control problem, Time-inconsistency, multi-person hierarchical differential games, time-consistent equilibrium strategy, Riccati--Volterra integral equation system..
Mathematics Subject Classification: Primary: 49L20, 49N10, 49N70; Secondary: 91A23, 91A6.
Citation: Jiongmin Yong. A deterministic linear quadratic time-inconsistent optimal control problem. Mathematical Control & Related Fields, 2011, 1 (1) : 83-118. doi: 10.3934/mcrf.2011.1.83
References:
[1]

S. Basak and G. Chabakauri, Dynamic mean-variance asset allocation,, Preprint, (2008).   Google Scholar

[2]

L. D. Berkovitz, "Optimal Control Theory,", Applied Mathematical Sciences, 12 (1974).   Google Scholar

[3]

T. Björk and A. Murgoci, A general theory of Markovian time inconsistent stochasitc control problem,, working paper., ().   Google Scholar

[4]

E. V. Böhm-Bawerk, "The Positive Theory of Capital,", Books for Libraries Press, (1891).   Google Scholar

[5]

I. Ekeland and A. Lazrak, Being serious about non-commitment: subgame perfect equilibrium in continuous time,, preprint, (2008).   Google Scholar

[6]

I. Ekeland and T. Privu, Investment and consumption without commitment,, preprint, (2007).   Google Scholar

[7]

S. M. Goldman, Consistent plans,, Review of Economic Studies, 47 (1980), 533.  doi: 10.2307/2297304.  Google Scholar

[8]

S. R. Grenadier and N. Wang, Investment under uncertainty and time-inconsistent preferences,, preprint., ().   Google Scholar

[9]

P. J. Herings and K. I. M. Rohde, Time-inconsistent preferences in a general equilibriub model,, preprint., ().   Google Scholar

[10]

D. Hume, "A Treatise of Human Nature,", First Edition, (1739).   Google Scholar

[11]

W. S. Jevons, "Theory of Political Economy,", Mcmillan, (1871).   Google Scholar

[12]

P. Krusell and A. A. Smith, Jr., Consumption and saving decisions with quasi-geometric discounting,, Econometrica, 71 (2003), 366.  doi: 10.1111/1468-0262.00400.  Google Scholar

[13]

D. Laibson, Golden eggs and hyperbolic discounting,, Quarterly J. Econ., 112 (1997), 443.  doi: 10.1162/003355397555253.  Google Scholar

[14]

A. Malthus, An essay on the principle of population, 1826,, in, 2 (1986).   Google Scholar

[15]

J. Marin-Solano and J. Navas, Non-constant discounting in finite horizon: The free terminal time case,, J. Economic Dynamics and Control, 33 (2009), 666.  doi: 10.1016/j.jedc.2008.08.008.  Google Scholar

[16]

A. Marshall, "Principles of Economics,", 1st ed., (1890).   Google Scholar

[17]

M. Miller and M. Salmon, Dynamic games and the time inconsistency of optimal policy in open economics,, The Economic Journal, 95 (1985), 124.  doi: 10.2307/2232876.  Google Scholar

[18]

I. Palacios-Huerta, Time-inconsistent preferences in Adam Smith and Davis Hume,, History of Political Economy, 35 (2003), 241.  doi: 10.1215/00182702-35-2-241.  Google Scholar

[19]

V. Pareto, "Manuel d'économie Politique,", Girard and Brieve, (1909).   Google Scholar

[20]

B. Peleg and M. E. Yaari, On the existence of a consistent course of action when tastes are changing,, Review of Economic Studies, 40 (1973), 391.  doi: 10.2307/2296458.  Google Scholar

[21]

R. A. Pollak, Consistent planning,, Review of Economic Studies, 35 (1968), 185.  doi: 10.2307/2296548.  Google Scholar

[22]

A. Smith, "The Theory of Moral Sentiments,", First Edition, (1759).   Google Scholar

[23]

R. H. Strotz, Myopia and inconsistency in dynamic utility maximization,, Review of Econ. Studies, 23 (1955), 165.  doi: 10.2307/2295722.  Google Scholar

[24]

L. Tesfatsion, Time inconsistency of benevolent government economics,, J. Public Economics, 31 (1986), 25.  doi: 10.1016/0047-2727(86)90070-8.  Google Scholar

[25]

J. Yong, A deterministic time-inconsistent optimal control problem -- An essentially cooperative approach,, Acta Appl. Math. Sinica, ().   Google Scholar

[26]

J. Yong, and X. Y. Zhou, "Stochastic Controls: Hamiltonian Systems and HJB Equations,", Applications of Mathematics (New York), (1999).   Google Scholar

show all references

References:
[1]

S. Basak and G. Chabakauri, Dynamic mean-variance asset allocation,, Preprint, (2008).   Google Scholar

[2]

L. D. Berkovitz, "Optimal Control Theory,", Applied Mathematical Sciences, 12 (1974).   Google Scholar

[3]

T. Björk and A. Murgoci, A general theory of Markovian time inconsistent stochasitc control problem,, working paper., ().   Google Scholar

[4]

E. V. Böhm-Bawerk, "The Positive Theory of Capital,", Books for Libraries Press, (1891).   Google Scholar

[5]

I. Ekeland and A. Lazrak, Being serious about non-commitment: subgame perfect equilibrium in continuous time,, preprint, (2008).   Google Scholar

[6]

I. Ekeland and T. Privu, Investment and consumption without commitment,, preprint, (2007).   Google Scholar

[7]

S. M. Goldman, Consistent plans,, Review of Economic Studies, 47 (1980), 533.  doi: 10.2307/2297304.  Google Scholar

[8]

S. R. Grenadier and N. Wang, Investment under uncertainty and time-inconsistent preferences,, preprint., ().   Google Scholar

[9]

P. J. Herings and K. I. M. Rohde, Time-inconsistent preferences in a general equilibriub model,, preprint., ().   Google Scholar

[10]

D. Hume, "A Treatise of Human Nature,", First Edition, (1739).   Google Scholar

[11]

W. S. Jevons, "Theory of Political Economy,", Mcmillan, (1871).   Google Scholar

[12]

P. Krusell and A. A. Smith, Jr., Consumption and saving decisions with quasi-geometric discounting,, Econometrica, 71 (2003), 366.  doi: 10.1111/1468-0262.00400.  Google Scholar

[13]

D. Laibson, Golden eggs and hyperbolic discounting,, Quarterly J. Econ., 112 (1997), 443.  doi: 10.1162/003355397555253.  Google Scholar

[14]

A. Malthus, An essay on the principle of population, 1826,, in, 2 (1986).   Google Scholar

[15]

J. Marin-Solano and J. Navas, Non-constant discounting in finite horizon: The free terminal time case,, J. Economic Dynamics and Control, 33 (2009), 666.  doi: 10.1016/j.jedc.2008.08.008.  Google Scholar

[16]

A. Marshall, "Principles of Economics,", 1st ed., (1890).   Google Scholar

[17]

M. Miller and M. Salmon, Dynamic games and the time inconsistency of optimal policy in open economics,, The Economic Journal, 95 (1985), 124.  doi: 10.2307/2232876.  Google Scholar

[18]

I. Palacios-Huerta, Time-inconsistent preferences in Adam Smith and Davis Hume,, History of Political Economy, 35 (2003), 241.  doi: 10.1215/00182702-35-2-241.  Google Scholar

[19]

V. Pareto, "Manuel d'économie Politique,", Girard and Brieve, (1909).   Google Scholar

[20]

B. Peleg and M. E. Yaari, On the existence of a consistent course of action when tastes are changing,, Review of Economic Studies, 40 (1973), 391.  doi: 10.2307/2296458.  Google Scholar

[21]

R. A. Pollak, Consistent planning,, Review of Economic Studies, 35 (1968), 185.  doi: 10.2307/2296548.  Google Scholar

[22]

A. Smith, "The Theory of Moral Sentiments,", First Edition, (1759).   Google Scholar

[23]

R. H. Strotz, Myopia and inconsistency in dynamic utility maximization,, Review of Econ. Studies, 23 (1955), 165.  doi: 10.2307/2295722.  Google Scholar

[24]

L. Tesfatsion, Time inconsistency of benevolent government economics,, J. Public Economics, 31 (1986), 25.  doi: 10.1016/0047-2727(86)90070-8.  Google Scholar

[25]

J. Yong, A deterministic time-inconsistent optimal control problem -- An essentially cooperative approach,, Acta Appl. Math. Sinica, ().   Google Scholar

[26]

J. Yong, and X. Y. Zhou, "Stochastic Controls: Hamiltonian Systems and HJB Equations,", Applications of Mathematics (New York), (1999).   Google Scholar

[1]

Shan Liu, Hui Zhao, Ximin Rong. Time-consistent investment-reinsurance strategy with a defaultable security under ambiguous environment. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2021015
[2]

Lars Grüne, Roberto Guglielmi. On the relation between turnpike properties and dissipativity for continuous time linear quadratic optimal control problems. Mathematical Control & Related Fields, 2021, 11 (1) : 169-188. doi: 10.3934/mcrf.2020032
[3]

Jingrui Sun, Hanxiao Wang. Mean-field stochastic linear-quadratic optimal control problems: Weak closed-loop solvability. Mathematical Control & Related Fields, 2021, 11 (1) : 47-71. doi: 10.3934/mcrf.2020026
[4]

Reza Chaharpashlou, Abdon Atangana, Reza Saadati. On the fuzzy stability results for fractional stochastic Volterra integral equation. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020432
[5]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[6]

Hai Huang, Xianlong Fu. Optimal control problems for a neutral integro-differential system with infinite delay. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020107
[7]

Awais Younus, Zoubia Dastgeer, Nudrat Ishaq, Abdul Ghaffar, Kottakkaran Sooppy Nisar, Devendra Kumar. On the observability of conformable linear time-invariant control systems. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020444
[8]

Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020046
[9]

Xiaoping Zhai, Yongsheng Li. Global large solutions and optimal time-decay estimates to the Korteweg system. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1387-1413. doi: 10.3934/dcds.2020322
[10]

Guangjun Shen, Xueying Wu, Xiuwei Yin. Stabilization of stochastic differential equations driven by G-Lévy process with discrete-time feedback control. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 755-774. doi: 10.3934/dcdsb.2020133
[11]

Nguyen Anh Tuan, Donal O'Regan, Dumitru Baleanu, Nguyen H. Tuan. On time fractional pseudo-parabolic equations with nonlocal integral conditions. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020109
[12]

Max E. Gilmore, Chris Guiver, Hartmut Logemann. Sampled-data integral control of multivariable linear infinite-dimensional systems with input nonlinearities. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021001
[13]

Liang Huang, Jiao Chen. The boundedness of multi-linear and multi-parameter pseudo-differential operators. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2020291
[14]

Yi Zhou, Jianli Liu. The initial-boundary value problem on a strip for the equation of time-like extremal surfaces. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 381-397. doi: 10.3934/dcds.2009.23.381
[15]

Xu Zhang, Chuang Zheng, Enrique Zuazua. Time discrete wave equations: Boundary observability and control. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 571-604. doi: 10.3934/dcds.2009.23.571
[16]

Kerioui Nadjah, Abdelouahab Mohammed Salah. Stability and Hopf bifurcation of the coexistence equilibrium for a differential-algebraic biological economic system with predator harvesting. Electronic Research Archive, 2021, 29 (1) : 1641-1660. doi: 10.3934/era.2020084
[17]

Vaibhav Mehandiratta, Mani Mehra, Günter Leugering. Fractional optimal control problems on a star graph: Optimality system and numerical solution. Mathematical Control & Related Fields, 2021, 11 (1) : 189-209. doi: 10.3934/mcrf.2020033
[18]

Stefan Ruschel, Serhiy Yanchuk. The spectrum of delay differential equations with multiple hierarchical large delays. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 151-175. doi: 10.3934/dcdss.2020321
[19]

Klemens Fellner, Jeff Morgan, Bao Quoc Tang. Uniform-in-time bounds for quadratic reaction-diffusion systems with mass dissipation in higher dimensions. Discrete & Continuous Dynamical Systems - S, 2021, 14 (2) : 635-651. doi: 10.3934/dcdss.2020334
[20]

Christian Clason, Vu Huu Nhu, Arnd Rösch. Optimal control of a non-smooth quasilinear elliptic equation. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020052

2019 Impact Factor: 0.857

Tools

Metrics

  • PDF downloads (84)
  • HTML views (0)
  • Cited by (25)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences