American Institute of Mathematical Sciences

Advanced
2015, 5(3): 275-288. doi: 10.3934/naco.2015.5.275

Output regulation for discrete-time nonlinear stochastic optimal control problems with model-reality differences

Sie Long Kek 1, and  Mohd Ismail Abd Aziz 2,

1. 

Department of Mathematics, Universiti Tun Hussein Onn Malaysia, 86400 Parit Raja, Malaysia
2. 

Department of Mathematics, Universiti Teknologi Malaysia, 81310 UTM, Skudai, Malaysia

Received  May 2014 Revised  March 2015 Published  August 2015

In this paper, we propose an output regulation approach, which is based on principle of model-reality differences, to obtain the optimal output measurement of a discrete-time nonlinear stochastic optimal control problem. In our approach, a model-based optimal control problem with adding the adjustable parameters is considered. We aim to regulate the optimal output trajectory of the model used as closely as possible to the output measurement of the original optimal control problem. In doing so, an expanded optimal control problem is introduced, where system optimization and parameter estimation are integrated. During the computation procedure, the differences between the real plant and the model used are measured repeatedly. In such a way, the optimal solution of the model is updated. At the end of iteration, the converged solution approaches closely to the true optimal solution of the original optimal control problem in spite of model-reality differences. It is important to notice that the resulting algorithm could give the output residual that is superior to those obtained from Kalman filtering theory. The accuracy of the output regulation is therefore highly recommended. For illustration, a continuous stirred-tank reactor problem is studied. The results obtained show the efficiency of the approach proposed.
Keywords: stochastic optimal control, Output regulation, adjustable parameters., iterative algorithm, model-reality differences.
Mathematics Subject Classification: Primary: 93E20, 93E10; Secondary: 93C1.
Citation: Sie Long Kek, Mohd Ismail Abd Aziz. Output regulation for discrete-time nonlinear stochastic optimal control problems with model-reality differences. Numerical Algebra, Control & Optimization, 2015, 5 (3) : 275-288. doi: 10.3934/naco.2015.5.275
References:
[1]

V. M. Becerra and P. D. Roberts, Dynamic integrated system optimization and parameter estimation for discrete time optimal control of nonlinear systems,, \emph{Int. J. Control}, 63 (1996), 257.  doi: 10.1080/00207179608921843.  Google Scholar

[2]

A. E. Bryson and Y. C. Ho, Applied Optimal Control,, Hemisphere Publishing Company, (1975).   Google Scholar

[3]

S. L. Kek and A. A. Mohd Ismail, Optimal control of discrete-time linear stochastic dynamic system with model-reality differences,, in \emph{Proceeding of International Conference on Machine Learning and Computing (ICML 2009)}, (2009), 10.   Google Scholar

[4]

S. L. Kek, K. L. Teo and A. A. Mohd Ismail, An integrated optimal control algorithm for discrete-time nonlinear stochastic system,, \emph{International Journal of Control}, 83 (2010), 2536.  doi: 10.1080/00207179.2010.531766.  Google Scholar

[5]

S. L. Kek, K. L. Teo and A. A. Mohd Ismail, Filtering solution of nonlinear stochastic optimal control problem in discrete-time with model-reality differences,, \emph{Numerical Algebra, 2 (2012), 207.  doi: 10.3934/naco.2012.2.207.  Google Scholar

[6]

S. L. Kek, A. A. Mohd Ismail, K. L. Teo and A. Rohanin, An iterative algorithm based on model-reality differences for discrete-time nonlinear stochastic optimal control problems,, \emph{Numerical Algebra, 3 (2013), 109.  doi: 10.3934/naco.2013.3.109.  Google Scholar

[7]

D. E. Kirk, Optimal Control Theory: An Introduction,, Mineola, (2004).   Google Scholar

[8]

F. L. Lewis and V. L. Syrmos, Optimal Control,, 2nd ed, (1995).   Google Scholar

[9]

A. A. Mohd Ismail and S. L. Kek, Optimal control of nonlinear discrete-time stochastic system with model-reality differences,, in \emph{2009 IEEE International Conference on Control and Automation}, (2009), 9.   Google Scholar

[10]

A. A. Mohd Ismail, A. Rohanin, S. L. Kek and K. L. Teo, Computational integrated optimal control and estimation with model information for discrete-time nonlinear stochastic dynamic system,, in \emph{Proceeding of the 2010 IRAST Internation Congress on Computer Applications and Computational Science (CACS 2010)}, (2010), 4.   Google Scholar

[11]

P. D. Roberts and T. W. C. Williams, On an algorithm for combined system optimization and parameter estimation,, \emph{Automatica}, 17 (1981), 199.  doi: 10.1016/0005-1098(81)90095-9.  Google Scholar

[12]

P. D. Roberts, Optimal control of nonlinear systems with model-reality differences,, \emph{Proceedings of the 31st IEEE Conference on Decision and Control}, 1 (1992), 257.   Google Scholar

show all references

References:
[1]

V. M. Becerra and P. D. Roberts, Dynamic integrated system optimization and parameter estimation for discrete time optimal control of nonlinear systems,, \emph{Int. J. Control}, 63 (1996), 257.  doi: 10.1080/00207179608921843.  Google Scholar

[2]

A. E. Bryson and Y. C. Ho, Applied Optimal Control,, Hemisphere Publishing Company, (1975).   Google Scholar

[3]

S. L. Kek and A. A. Mohd Ismail, Optimal control of discrete-time linear stochastic dynamic system with model-reality differences,, in \emph{Proceeding of International Conference on Machine Learning and Computing (ICML 2009)}, (2009), 10.   Google Scholar

[4]

S. L. Kek, K. L. Teo and A. A. Mohd Ismail, An integrated optimal control algorithm for discrete-time nonlinear stochastic system,, \emph{International Journal of Control}, 83 (2010), 2536.  doi: 10.1080/00207179.2010.531766.  Google Scholar

[5]

S. L. Kek, K. L. Teo and A. A. Mohd Ismail, Filtering solution of nonlinear stochastic optimal control problem in discrete-time with model-reality differences,, \emph{Numerical Algebra, 2 (2012), 207.  doi: 10.3934/naco.2012.2.207.  Google Scholar

[6]

S. L. Kek, A. A. Mohd Ismail, K. L. Teo and A. Rohanin, An iterative algorithm based on model-reality differences for discrete-time nonlinear stochastic optimal control problems,, \emph{Numerical Algebra, 3 (2013), 109.  doi: 10.3934/naco.2013.3.109.  Google Scholar

[7]

D. E. Kirk, Optimal Control Theory: An Introduction,, Mineola, (2004).   Google Scholar

[8]

F. L. Lewis and V. L. Syrmos, Optimal Control,, 2nd ed, (1995).   Google Scholar

[9]

A. A. Mohd Ismail and S. L. Kek, Optimal control of nonlinear discrete-time stochastic system with model-reality differences,, in \emph{2009 IEEE International Conference on Control and Automation}, (2009), 9.   Google Scholar

[10]

A. A. Mohd Ismail, A. Rohanin, S. L. Kek and K. L. Teo, Computational integrated optimal control and estimation with model information for discrete-time nonlinear stochastic dynamic system,, in \emph{Proceeding of the 2010 IRAST Internation Congress on Computer Applications and Computational Science (CACS 2010)}, (2010), 4.   Google Scholar

[11]

P. D. Roberts and T. W. C. Williams, On an algorithm for combined system optimization and parameter estimation,, \emph{Automatica}, 17 (1981), 199.  doi: 10.1016/0005-1098(81)90095-9.  Google Scholar

[12]

P. D. Roberts, Optimal control of nonlinear systems with model-reality differences,, \emph{Proceedings of the 31st IEEE Conference on Decision and Control}, 1 (1992), 257.   Google Scholar

[1]

Youming Guo, Tingting Li. Optimal control strategies for an online game addiction model with low and high risk exposure. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020347
[2]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[3]

Bernard Bonnard, Jérémy Rouot. Geometric optimal techniques to control the muscular force response to functional electrical stimulation using a non-isometric force-fatigue model. Journal of Geometric Mechanics, 2020  doi: 10.3934/jgm.2020032
[4]

Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020046
[5]

Siyang Cai, Yongmei Cai, Xuerong Mao. A stochastic differential equation SIS epidemic model with regime switching. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020317
[6]

Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077
[7]

Christopher S. Goodrich, Benjamin Lyons, Mihaela T. Velcsov. Analytical and numerical monotonicity results for discrete fractional sequential differences with negative lower bound. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2020269
[8]

Suhaib Abduljabbar Altamir, Zakariya Yahya Algamal. Improving whale optimization algorithm for feature selection with a time-varying transfer function. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 87-98. doi: 10.3934/naco.2020017
[9]

José Madrid, João P. G. Ramos. On optimal autocorrelation inequalities on the real line. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2020271
[10]

Zhenzhen Wang, Tianshou Zhou. Asymptotic behaviors and stochastic traveling waves in stochastic Fisher-KPP equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020323
[11]

Hui Lv, Xing'an Wang. Dissipative control for uncertain singular markovian jump systems via hybrid impulsive control. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 127-142. doi: 10.3934/naco.2020020
[12]

Tommi Brander, Joonas Ilmavirta, Petteri Piiroinen, Teemu Tyni. Optimal recovery of a radiating source with multiple frequencies along one line. Inverse Problems & Imaging, 2020, 14 (6) : 967-983. doi: 10.3934/ipi.2020044
[13]

Lorenzo Zambotti. A brief and personal history of stochastic partial differential equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 471-487. doi: 10.3934/dcds.2020264
[14]

Awais Younus, Zoubia Dastgeer, Nudrat Ishaq, Abdul Ghaffar, Kottakkaran Sooppy Nisar, Devendra Kumar. On the observability of conformable linear time-invariant control systems. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020444
[15]

Laurence Cherfils, Stefania Gatti, Alain Miranville, Rémy Guillevin. Analysis of a model for tumor growth and lactate exchanges in a glioma. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020457
[16]

Laurent Di Menza, Virginie Joanne-Fabre. An age group model for the study of a population of trees. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020464
[17]

Yongge Tian, Pengyang Xie. Simultaneous optimal predictions under two seemingly unrelated linear random-effects models. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020168
[18]

Xuhui Peng, Rangrang Zhang. Approximations of stochastic 3D tamed Navier-Stokes equations. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5337-5365. doi: 10.3934/cpaa.2020241
[19]

Yahia Zare Mehrjerdi. A new methodology for solving bi-criterion fractional stochastic programming. Numerical Algebra, Control & Optimization, 2020  doi: 10.3934/naco.2020054
[20]

Yueyang Zheng, Jingtao Shi. A stackelberg game of backward stochastic differential equations with partial information. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020047

 Impact Factor: 

Tools

Metrics

  • PDF downloads (23)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences