A limit theorem for Markov decision processes
Mathias Staudigl
In this paper I prove a deterministic approximation theorem for a sequence of Markov decision processes with finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty assumptions are imposed on the value function.
keywords: Markov decision processes optimal control viscosity solutions weak convergence methods.
On repeated games with imperfect public monitoring: From discrete to continuous time
Mathias Staudigl Jan-Henrik Steg

Motivated by recent path-breaking contributions in the theory of repeated games in continuous time, this paper presents a family of discrete-time games which provides a consistent discrete-time approximation of the continuous-time limit game. Using probabilistic arguments, we prove that continuous-time games can be defined as the limit of a sequence of discrete-time games. Our convergence analysis reveals various intricacies of continuous-time games. First, we demonstrate the importance of correlated strategies in continuous-time. Second, we attach a precise meaning to the statement that a sequence of discrete-time games can be used to approximate a continuous-time game.

keywords: Continuous-time game theory perfect-public equilibrium weak convergence

Year of publication

Related Authors

Related Keywords

[Back to Top]