American Institute of Mathematical Sciences

Advanced
January  2010, 6(1): 161-175. doi: 10.3934/jimo.2010.6.161

The viscosity approximation to the Hamilton-Jacobi-Bellman equation in optimal feedback control: Upper bounds for extended domains

Steven Richardson 1, and  Song Wang 2,

1. 

School of Engineering, Edith Cowan University, 270 Joondalup Drive, Joondalup 6027, Australia
2. 

School of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009

Received  June 2008 Revised  September 2009 Published  November 2009

A number of numerical methods for solving optimal feedback control problems are based on the viscosity approximation to the Hamilton-Jacobi-Bellman (HJB) equation, with artificial boundary conditions defined on an extended domain. An upper bound for this extended domain is established, ensuring that the approximate solution converges to the viscosity solution of the HJB equation on some pre-defined domain of interest.
Keywords: Viscosity solutions, Hamilton-Jacobi-Bellman equation, Viscosity approximation, Domain of dependence., Optimal feedback Control.
Mathematics Subject Classification: Primary: 49N35; 49L25; Secondary: 35L6.
Citation: Steven Richardson, Song Wang. The viscosity approximation to the Hamilton-Jacobi-Bellman equation in optimal feedback control: Upper bounds for extended domains. Journal of Industrial & Management Optimization, 2010, 6 (1) : 161-175. doi: 10.3934/jimo.2010.6.161
[1]

Jean-Claude Zambrini. On the geometry of the Hamilton-Jacobi-Bellman equation. Journal of Geometric Mechanics, 2009, 1 (3) : 369-387. doi: 10.3934/jgm.2009.1.369
[2]

Kaizhi Wang, Jun Yan. Lipschitz dependence of viscosity solutions of Hamilton-Jacobi equations with respect to the parameter. Discrete & Continuous Dynamical Systems - A, 2016, 36 (3) : 1649-1659. doi: 10.3934/dcds.2016.36.1649
[3]

Daniele Castorina, Annalisa Cesaroni, Luca Rossi. On a parabolic Hamilton-Jacobi-Bellman equation degenerating at the boundary. Communications on Pure & Applied Analysis, 2016, 15 (4) : 1251-1263. doi: 10.3934/cpaa.2016.15.1251
[4]

Mohamed Assellaou, Olivier Bokanowski, Hasnaa Zidani. Error estimates for second order Hamilton-Jacobi-Bellman equations. Approximation of probabilistic reachable sets. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 3933-3964. doi: 10.3934/dcds.2015.35.3933
[5]

Mihai Bostan, Gawtum Namah. Time periodic viscosity solutions of Hamilton-Jacobi equations. Communications on Pure & Applied Analysis, 2007, 6 (2) : 389-410. doi: 10.3934/cpaa.2007.6.389
[6]

Olga Bernardi, Franco Cardin. Minimax and viscosity solutions of Hamilton-Jacobi equations in the convex case. Communications on Pure & Applied Analysis, 2006, 5 (4) : 793-812. doi: 10.3934/cpaa.2006.5.793
[7]

Shanjian Tang, Fu Zhang. Path-dependent optimal stochastic control and viscosity solution of associated Bellman equations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (11) : 5521-5553. doi: 10.3934/dcds.2015.35.5521
[8]

Kai Zhao, Wei Cheng. On the vanishing contact structure for viscosity solutions of contact type Hamilton-Jacobi equations I: Cauchy problem. Discrete & Continuous Dynamical Systems - A, 2019, 39 (8) : 4345-4358. doi: 10.3934/dcds.2019176
[9]

Thomas Strömberg. A system of the Hamilton--Jacobi and the continuity equations in the vanishing viscosity limit. Communications on Pure & Applied Analysis, 2011, 10 (2) : 479-506. doi: 10.3934/cpaa.2011.10.479
[10]

Eddaly Guerra, Héctor Sánchez-Morgado. Vanishing viscosity limits for space-time periodic Hamilton-Jacobi equations. Communications on Pure & Applied Analysis, 2014, 13 (1) : 331-346. doi: 10.3934/cpaa.2014.13.331
[11]

Nalini Anantharaman, Renato Iturriaga, Pablo Padilla, Héctor Sánchez-Morgado. Physical solutions of the Hamilton-Jacobi equation. Discrete & Continuous Dynamical Systems - B, 2005, 5 (3) : 513-528. doi: 10.3934/dcdsb.2005.5.513
[12]

Federica Masiero. Hamilton Jacobi Bellman equations in infinite dimensions with quadratic and superquadratic Hamiltonian. Discrete & Continuous Dynamical Systems - A, 2012, 32 (1) : 223-263. doi: 10.3934/dcds.2012.32.223
[13]

Mariane Bourgoing. Viscosity solutions of fully nonlinear second order parabolic equations with $L^1$ dependence in time and Neumann boundary conditions. Discrete & Continuous Dynamical Systems - A, 2008, 21 (3) : 763-800. doi: 10.3934/dcds.2008.21.763
[14]

Joan-Andreu Lázaro-Camí, Juan-Pablo Ortega. The stochastic Hamilton-Jacobi equation. Journal of Geometric Mechanics, 2009, 1 (3) : 295-315. doi: 10.3934/jgm.2009.1.295
[15]

Pierpaolo Soravia. Existence of absolute minimizers for noncoercive Hamiltonians and viscosity solutions of the Aronsson equation. Mathematical Control & Related Fields, 2012, 2 (4) : 399-427. doi: 10.3934/mcrf.2012.2.399
[16]

Jingyu Li, Chuangchuang Liang. Viscosity dominated limit of global solutions to a hyperbolic equation in MEMS. Discrete & Continuous Dynamical Systems - A, 2016, 36 (2) : 833-849. doi: 10.3934/dcds.2016.36.833
[17]

Gang Li, Fen Gu, Feida Jiang. Positive viscosity solutions of a third degree homogeneous parabolic infinity Laplace equation. Communications on Pure & Applied Analysis, 2020, 19 (3) : 1449-1462. doi: 10.3934/cpaa.2020071
[18]

Boris Andreianov, Kenneth H. Karlsen, Nils H. Risebro. On vanishing viscosity approximation of conservation laws with discontinuous flux. Networks & Heterogeneous Media, 2010, 5 (3) : 617-633. doi: 10.3934/nhm.2010.5.617
[19]

Tomoki Ohsawa, Anthony M. Bloch. Nonholonomic Hamilton-Jacobi equation and integrability. Journal of Geometric Mechanics, 2009, 1 (4) : 461-481. doi: 10.3934/jgm.2009.1.461
[20]

María Barbero-Liñán, Manuel de León, David Martín de Diego, Juan C. Marrero, Miguel C. Muñoz-Lecanda. Kinematic reduction and the Hamilton-Jacobi equation. Journal of Geometric Mechanics, 2012, 4 (3) : 207-237. doi: 10.3934/jgm.2012.4.207

2018 Impact Factor: 1.025

Tools

Metrics

  • PDF downloads (38)
  • HTML views (0)
  • Cited by (6)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences