January  2005, 1(1): 65-80. doi: 10.3934/jimo.2005.1.65

Two new optimal models for controlling discrete event systems


College of International Business and Management, Shanghai University, Shanghai 201800, China


Department of Intelligence and Informatics, Konan University, 8-9-1 Okamoto, Kobe 658-8501, Japan

Received  May 2004 Revised  November 2004 Published  January 2005

Supervisory control belongs essentially to the logic level for control problems in discrete event systems (DESs) and its corresponding control task is hard. This is unlike many practical optimal control problems which belong to the performance level and whose control tasks are soft. In this paper, we present two new optimal control problems of DESs: one with cost functions for choosing control inputs, and the other for occurring events. Their performance measures are to minimize the maximal discounted total cost among all possible strings that the system generates. Since this is a nonlinear optimization problem, we model such systems by using Markov decision processes. We then present the optimality equations for both control problems and obtain their optimal solutions. When the cost functions are stationary, we show that both the optimality equations and their solutions are also stationary. We then use these equations and solutions to describe and solve uniformly the basic synthesizing problems in the two branches of the supervisory control area: those being the event feedback control and the state feedback control. Moreover, we show that the control invariant languages and the control invariant predicates with their permissive supervisors and state feedbacks not only have meanings in supervisory control of DESs, but are also the optimal solutions for some optimal control problems. This shows a link existing between the logic level and the performance level for the control of discrete event systems. Finally, a numerical example is given to illustrate some results for supervisory control of a DES.
Citation: Qiying Hu, Wuyi Yue. Two new optimal models for controlling discrete event systems. Journal of Industrial & Management Optimization, 2005, 1 (1) : 65-80. doi: 10.3934/jimo.2005.1.65

Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems II: Control synthesis problems. Journal of Industrial & Management Optimization, 2008, 4 (4) : 713-726. doi: 10.3934/jimo.2008.4.713


Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial & Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63


Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems I: framework and maximal permissive state feedback. Journal of Industrial & Management Optimization, 2008, 4 (1) : 107-123. doi: 10.3934/jimo.2008.4.107


Qiying Hu, Wuyi Yue. Optimal control for discrete event systems with arbitrary control pattern. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 535-558. doi: 10.3934/dcdsb.2006.6.535


Changzhi Wu, Kok Lay Teo, Volker Rehbock. Optimal control of piecewise affine systems with piecewise affine state feedback. Journal of Industrial & Management Optimization, 2009, 5 (4) : 737-747. doi: 10.3934/jimo.2009.5.737


Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082


Stefan Jerg, Oliver Junge, Marcus Post. Global optimal feedbacks for stochastic quantized nonlinear event systems. Journal of Computational Dynamics, 2014, 1 (1) : 163-176. doi: 10.3934/jcd.2014.1.163


Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete & Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011


Galina Kurina, Sahlar Meherrem. Decomposition of discrete linear-quadratic optimal control problems for switching systems. Conference Publications, 2015, 2015 (special) : 764-774. doi: 10.3934/proc.2015.0764


Ran Dong, Xuerong Mao. Asymptotic stabilization of continuous-time periodic stochastic systems by feedback control based on periodic discrete-time observations. Mathematical Control & Related Fields, 2019, 0 (0) : 0-0. doi: 10.3934/mcrf.2020017


Elimhan N. Mahmudov. Optimal control of second order delay-discrete and delay-differential inclusions with state constraints. Evolution Equations & Control Theory, 2018, 7 (3) : 501-529. doi: 10.3934/eect.2018024


Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist. Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. Journal of Geometric Mechanics, 2013, 5 (1) : 1-38. doi: 10.3934/jgm.2013.5.1


N. U. Ahmed. Existence of optimal output feedback control law for a class of uncertain infinite dimensional stochastic systems: A direct approach. Evolution Equations & Control Theory, 2012, 1 (2) : 235-250. doi: 10.3934/eect.2012.1.235


Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete & Continuous Dynamical Systems - A, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153


Cristiana J. Silva, Helmut Maurer, Delfim F. M. Torres. Optimal control of a Tuberculosis model with state and control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 321-337. doi: 10.3934/mbe.2017021


Guirong Jiang, Qishao Lu. The dynamics of a Prey-Predator model with impulsive state feedback control. Discrete & Continuous Dynamical Systems - B, 2006, 6 (6) : 1301-1320. doi: 10.3934/dcdsb.2006.6.1301


Haiying Jing, Zhaoyu Yang. The impact of state feedback control on a predator-prey model with functional response. Discrete & Continuous Dynamical Systems - B, 2004, 4 (3) : 607-614. doi: 10.3934/dcdsb.2004.4.607


Meng Zhang, Kaiyuan Liu, Lansun Chen, Zeyu Li. State feedback impulsive control of computer worm and virus with saturated incidence. Mathematical Biosciences & Engineering, 2018, 15 (6) : 1465-1478. doi: 10.3934/mbe.2018067


Rohit Gupta, Farhad Jafari, Robert J. Kipka, Boris S. Mordukhovich. Linear openness and feedback stabilization of nonlinear control systems. Discrete & Continuous Dynamical Systems - S, 2018, 11 (6) : 1103-1119. doi: 10.3934/dcdss.2018063


Jérome Lohéac, Jean-François Scheid. Time optimal control for a nonholonomic system with state constraint. Mathematical Control & Related Fields, 2013, 3 (2) : 185-208. doi: 10.3934/mcrf.2013.3.185

2018 Impact Factor: 1.025


  • PDF downloads (12)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]