In this paper we study stochastic dynamic games with many players that are relevant for a wide range of social, economic, and engineering applications. The standard solution concept for such games is Markov perfect equilibrium (MPE), but it is well known that MPE computation becomes intractable as the number of players increases. Further, MPE demands a perhaps implausible level of rationality on the part of players in large games. In this paper we instead consider stationary equilibrium (SE), where players optimize assuming the empirical distribution of others' states remains constant at its long run average. We make three main contributions that provide foundations for using SE. First, we provide exogenous conditions over model primitives to ensure stationary equilibria exist, in a general model with possibly unbounded state spaces. Second, we show that the same conditions that ensure existence of SE also ensure that SE is a good approximation to MPE in large finite games. Final...
Sachin Adlakha, Ramesh Johari, Gabriel Y. Weintrau