# American Institute of Mathematical Sciences

• Previous Article
On the system of partial differential equations arising in mean field type control
• DCDS Home
• This Issue
• Next Article
Error estimates for second order Hamilton-Jacobi-Bellman equations. Approximation of probabilistic reachable sets
September  2015, 35(9): 3901-3931. doi: 10.3934/dcds.2015.35.3901

## Ergodicity conditions for zero-sum games

 1 INRIA and CMAP, Ecole polytechnique, CNRS, CMAP, Ecole polytechnique, Route de Saclay, 91128 Palaiseau Cedex, France, France, France

Received  May 2014 Revised  December 2014 Published  April 2015

A basic question for zero-sum repeated games consists in determining whether the mean payoff per time unit is independent of the initial state. In the special case of zero-player'' games, i.e., of Markov chains equipped with additive functionals, the answer is provided by the mean ergodic theorem. We generalize this result to repeated games. We show that the mean payoff is independent of the initial state for all state-dependent perturbations of the rewards if and only if an ergodicity condition is verified. The latter is characterized by the uniqueness modulo constants of nonlinear harmonic functions (fixed points of the recession function associated to the Shapley operator), or, in the special case of stochastic games with finite action spaces and perfect information, by a reachability condition involving conjugate subsets of states in directed hypergraphs. We show that the ergodicity condition for games only depends on the support of the transition probability, and that it can be checked in polynomial time when the number of states is fixed.
Citation: Marianne Akian, Stéphane Gaubert, Antoine Hochart. Ergodicity conditions for zero-sum games. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 3901-3931. doi: 10.3934/dcds.2015.35.3901
##### References:

show all references

##### References:
 [1] Antoine Hochart. An accretive operator approach to ergodic zero-sum stochastic games. Journal of Dynamics & Games, 2019, 6 (1) : 27-51. doi: 10.3934/jdg.2019003 [2] Salah Eddine Choutri, Boualem Djehiche, Hamidou Tembine. Optimal control and zero-sum games for Markov chains of mean-field type. Mathematical Control & Related Fields, 2019, 9 (3) : 571-605. doi: 10.3934/mcrf.2019026 [3] Alexander J. Zaslavski. Structure of approximate solutions of dynamic continuous time zero-sum games. Journal of Dynamics & Games, 2014, 1 (1) : 153-179. doi: 10.3934/jdg.2014.1.153 [4] Fernando Luque-Vásquez, J. Adolfo Minjárez-Sosa. Average optimal strategies for zero-sum Markov games with poorly known payoff function on one side. Journal of Dynamics & Games, 2014, 1 (1) : 105-119. doi: 10.3934/jdg.2014.1.105 [5] Xiangxiang Huang, Xianping Guo, Jianping Peng. A probability criterion for zero-sum stochastic games. Journal of Dynamics & Games, 2017, 4 (4) : 369-383. doi: 10.3934/jdg.2017020 [6] Shui-Hung Hou. On an application of fixed point theorem to nonlinear inclusions. Conference Publications, 2011, 2011 (Special) : 692-697. doi: 10.3934/proc.2011.2011.692 [7] Alexander J. Zaslavski. Turnpike properties of approximate solutions of dynamic discrete time zero-sum games. Journal of Dynamics & Games, 2014, 1 (2) : 299-330. doi: 10.3934/jdg.2014.1.299 [8] Sylvain Sorin, Guillaume Vigeral. Reversibility and oscillations in zero-sum discounted stochastic games. Journal of Dynamics & Games, 2015, 2 (1) : 103-115. doi: 10.3934/jdg.2015.2.103 [9] Beatris A. Escobedo-Trujillo. Discount-sensitive equilibria in zero-sum stochastic differential games. Journal of Dynamics & Games, 2016, 3 (1) : 25-50. doi: 10.3934/jdg.2016002 [10] Qingmeng Wei, Zhiyong Yu. Time-inconsistent recursive zero-sum stochastic differential games. Mathematical Control & Related Fields, 2018, 8 (3&4) : 1051-1079. doi: 10.3934/mcrf.2018045 [11] Jingzhen Liu, Ka Fai Cedric Yiu, Alain Bensoussan. Ergodic control for a mean reverting inventory model. Journal of Industrial & Management Optimization, 2018, 14 (3) : 857-876. doi: 10.3934/jimo.2017079 [12] Cecilia González-Tokman, Anthony Quas. A concise proof of the multiplicative ergodic theorem on Banach spaces. Journal of Modern Dynamics, 2015, 9: 237-255. doi: 10.3934/jmd.2015.9.237 [13] Yuri Kifer. Ergodic theorems for nonconventional arrays and an extension of the Szemerédi theorem. Discrete & Continuous Dynamical Systems - A, 2018, 38 (6) : 2687-2716. doi: 10.3934/dcds.2018113 [14] Alex Blumenthal. A volume-based approach to the multiplicative ergodic theorem on Banach spaces. Discrete & Continuous Dynamical Systems - A, 2016, 36 (5) : 2377-2403. doi: 10.3934/dcds.2016.36.2377 [15] Luciana A. Alves, Luiz A. B. San Martin. Multiplicative ergodic theorem on flag bundles of semi-simple Lie groups. Discrete & Continuous Dynamical Systems - A, 2013, 33 (4) : 1247-1273. doi: 10.3934/dcds.2013.33.1247 [16] Libin Mou, Jiongmin Yong. Two-person zero-sum linear quadratic stochastic differential games by a Hilbert space method. Journal of Industrial & Management Optimization, 2006, 2 (1) : 95-117. doi: 10.3934/jimo.2006.2.95 [17] Fabien Gensbittel, Miquel Oliu-Barton, Xavier Venel. Existence of the uniform value in zero-sum repeated games with a more informed controller. Journal of Dynamics & Games, 2014, 1 (3) : 411-445. doi: 10.3934/jdg.2014.1.411 [18] Valery Y. Glizer, Oleg Kelis. Singular infinite horizon zero-sum linear-quadratic differential game: Saddle-point equilibrium sequence. Numerical Algebra, Control & Optimization, 2017, 7 (1) : 1-20. doi: 10.3934/naco.2017001 [19] Martin Burger, Marco Di Francesco, Peter A. Markowich, Marie-Therese Wolfram. Mean field games with nonlinear mobilities in pedestrian dynamics. Discrete & Continuous Dynamical Systems - B, 2014, 19 (5) : 1311-1333. doi: 10.3934/dcdsb.2014.19.1311 [20] Yves Derriennic. Some aspects of recent works on limit theorems in ergodic theory with special emphasis on the "central limit theorem''. Discrete & Continuous Dynamical Systems - A, 2006, 15 (1) : 143-158. doi: 10.3934/dcds.2006.15.143

2018 Impact Factor: 1.143