Equilibria in Pure Strategies for a Two-Player Zero-Sum Average Stochastic Positional Game

The problem of the existence and determining equilibria in pure stationary strategies for a two-player zero-sum average stochastic positional game is considered. We show that for such a game there exists the value and players may achieve the value by applying pure stationary strategies of choosing the actions in their positions. Based on a constructive proof of these results we propose an algorithmic approach for determining the optimal pure stationary strategies of the players.