Determining the Equilibrium Solution in Two-Player Static Discrete Markovian Games

A mix of two or more strategies can be more helpful for players in future. This article introduces a series of games called Markovian Dynamic Games that if you consider the strategies of each player as a state, the player can select the same or another state depending on the situation in the next steps. The selecting each state in each step will be done with a specified probability. This probability is depending on the strategies of the competing players. In this study, a static two-player discrete game with Markov chain approach is considered that the probability of transfer is well-known, independent and is only influenced by the competitor's previous strategies. In this paper, the equilibrium points in markovian static games are evaluated and analyzed. Numerical examples are also presented for more explanations. In this paper, the difference between single-stage and multi-stage games in determining equilibrium points is shown. If a game is played in a multilevel manner, it is possible to design a discrete game as a Markov chain using the probability of transferring and considering the strategies of the game as a mode in each step, and by determining the probabilities of the specified chain, points He gained some balance. For this purpose, static games were considered. One of the most important advantages of using the Markov chain to determine the limit equilibrium point is to find this point in the shortest time and with the least available calculations.