| Epsilon-equilibrium | |
|---|---|
| Solution concept ingame theory | |
| Relationship | |
| Superset of | Nash Equilibrium |
| Significance | |
| Used for | stochastic games |
Ingame theory, anepsilon-equilibrium, or near-Nash equilibrium, is astrategy profile that approximatelysatisfies the condition ofNash equilibrium. In a Nash equilibrium, no player has an incentive to change hisbehavior. In an approximate Nash equilibrium, this requirement is weakened to allow the possibility that aplayer may have a small incentive to do something different. This may still be considered an adequatesolution concept, assuming for examplestatus quo bias. This solution concept may be preferred to Nashequilibrium due to being easier to compute, or alternatively due to the possibility that in games of morethan 2 players, the probabilities involved in an exact Nash equilibrium need not berational numbers.[1]
There is more than one alternative definition.
Given a game and a real non-negative parameter, astrategy profile is said to be an-equilibrium if it is not possible for any player to gain more than inexpected payoff by unilaterally deviating from hisstrategy.[2]: 45 EveryNash Equilibrium is equivalent to an-equilibrium where.
Formally, letbe an-player game with action sets for each player and utility function.Let denote the payoff to player whenstrategy profile is played.Let be the space of probability distributions over.A vector of strategies is an-Nash Equilibrium for if
Note that the utilities of all players are normalized to [0,1],[3] so this is actually amultiplicative approximation: the gain cannot be more than times the highest utility.
The following definition[4]imposes the stronger requirement that a player may only assign positive probability to a pure strategy if the payoff of has expected payoff at most less than the best response payoff.Let be the probability that strategy profile is played. For player let be strategy profiles of players other than; for and a pure strategy of let be the strategy profile where plays and other players play.Let be the payoff to when strategy profile is used.The requirement can be expressed by the formula
The existence of apolynomial-time approximation scheme (PTAS) for ε-Nash equilibria isequivalent to the question of whether there exists one for ε-well-supportedapproximate Nash equilibria,[5] but the existence of a PTAS remains an open problem.For constant values of ε, polynomial-time algorithms for approximate equilibriaare known for lower values of ε than are known for well-supportedapproximate equilibria.For games with payoffs in the range [0,1] and ε=0.3393, ε-Nash equilibria canbe computed in polynomial time.[6]For games with payoffs in the range [0,1] and ε=2/3, ε-well-supported equilibria canbe computed in polynomial time.[7]
The notion of ε-equilibria is important in the theory ofstochastic games of potentially infinite duration. There are simple examples of stochastic games with noNash equilibrium but with an ε-equilibrium for any ε strictly bigger than 0.
Perhaps the simplest such example is the following variant ofMatching Pennies, suggested by Everett. Player 1 hides a penny andPlayer 2 must guess if it is heads up or tails up. If Player 2 guesses correctly, hewins the penny from Player 1 and the game ends. If Player 2 incorrectly guesses that the penny is heads up,the game ends with payoff zero to both players. If he incorrectly guesses that it is tails up, the gamerepeats. If the play continues forever, the payoff to both players is zero.
Given a parameterε > 0, anystrategy profile where Player 2 guesses heads up withprobability ε and tails up with probability 1 − ε (at every stage of the game, and independentlyfrom previous stages) is anε-equilibrium for the game. The expected payoff of Player 2 insuch a strategy profile is at least 1 − ε. However, it is easy to see that there is nostrategy for Player 2 that can guarantee an expected payoff of exactly 1. Therefore, the gamehas noNash equilibrium.
Another simple example is the finitelyrepeated prisoner's dilemma for T periods, where the payoff is averaged over the T periods. The onlyNash equilibrium of this game is to choose Defect in each period. Now consider the two strategiestit-for-tat andgrim trigger. Although neithertit-for-tat norgrim trigger are Nash equilibria for the game, both of them are-equilibria for some positive. The acceptable values of depend on the payoffs of the constituent game and on the number T of periods.
In economics, the concept of apure strategyepsilon-equilibrium is used when the mixed-strategy approach is seen as unrealistic. In a pure-strategy epsilon-equilibrium, each player chooses a pure-strategy that is within epsilon of its best pure-strategy. For example, in theBertrand–Edgeworth model, where no pure-strategy equilibrium exists, a pure-strategy epsilon equilibrium may exist.