| Hypergeometric | |||
|---|---|---|---|
Probability mass function | |||
Cumulative distribution function | |||
| Parameters | |||
| Support | |||
| PMF | |||
| CDF | where is thegeneralized hypergeometric function | ||
| Mean | |||
| Mode | |||
| Variance | |||
| Skewness | |||
| Excess kurtosis | |||
| MGF | |||
| CF | |||
Inprobability theory andstatistics, thehypergeometric distribution is adiscrete probability distribution that describes the probability of successes (random draws for which the object drawn has a specified feature) in draws,without replacement, from a finitepopulation of size that contains exactly objects with that feature, where in each draw is either a success or a failure. In contrast, thebinomial distribution describes the probability of successes in drawswith replacement.
The following conditions characterize the hypergeometric distribution:
Arandom variable follows the hypergeometric distribution if itsprobability mass function (pmf) is given by[1]
where
A random variable distributed hypergeometrically with parameters, and is written and hasprobability mass function above.
As required, we have
which essentially follows fromVandermonde's identity fromcombinatorics.
Also note that
This identity can be shown by expressing the binomial coefficients in terms of factorials and rearranging the latter. Additionally, itfollows from the symmetry of the problem, described in two different but interchangeable ways.
For example, consider two rounds of drawing without replacement. In the first round, out of neutral marbles are drawn from an urn without replacement and coloured green. Then the colored marbles are put back. In the second round, marbles are drawn without replacement and colored red. Then, the number of marbles with both colors on them (that is, the number of marbles that have been drawn twice) has the hypergeometric distribution. The symmetry in and stems from the fact that the two rounds are independent, and one could have started by drawing balls and colouring them red first.
Note that we are interested in the probability of successes in drawswithout replacement, since the probability of success on each trial is not the same, as the size of the remaining population changes as we remove each marble. Keep in mind not to confuse with thebinomial distribution, which describes the probability of successes in drawswith replacement.
The classical application of the hypergeometric distribution issampling without replacement. Think of anurn with two colors ofmarbles, red and green. Define drawing a green marble as a success and drawing a red marble as a failure. LetN describe the number ofall marbles in the urn (see contingency table below) andK describe the number ofgreen marbles, thenN − K corresponds to the number ofred marbles. Now, standing next to the urn, you close your eyes and draw n marbles without replacement. DefineX as arandom variable whose outcome isk, the number of green marbles drawn in the experiment. This situation is illustrated by the followingcontingency table:
| drawn | not drawn | total | |
|---|---|---|---|
| green marbles | k | K −k | K |
| red marbles | n −k | N + k − n − K | N − K |
| total | n | N − n | N |
Indeed, we are interested in calculating the probability of drawing k green marbles in n draws, given that there are K green marbles out of a total of N marbles. For this example, assume that there are5 green and45 red marbles in the urn. Standing next to the urn, you close your eyes and draw10 marbles without replacement. What is the probability that exactly4 of the10 are green?
This problem is summarized by the following contingency table:
| drawn | not drawn | total | |
|---|---|---|---|
| green marbles | k =4 | K −k =1 | K =5 |
| red marbles | n −k =6 | N + k − n − K =39 | N − K =45 |
| total | n =10 | N − n =40 | N =50 |
To find the probability ofdrawing k green marbles in exactly n draws out of N total draws, we identify X as a hyper-geometric random variable to use the formula
To intuitively explain the given formula, consider the two symmetric problems represented by the identity
Back to the calculations, we use the formula above to calculate the probability of drawing exactlyk green marbles
Intuitively we would expect it to be even more unlikely that all 5 green marbles will be among the 10 drawn.
As expected, the probability of drawing 5 green marbles is roughly 35 times less likely than that of drawing 4.
Swapping the roles of green and red marbles:
Swapping the roles of drawn and not drawn marbles:
Swapping the roles of green and drawn marbles:
These symmetries generate thedihedral group.
The probability of drawing any set of green and red marbles (the hypergeometric distribution) depends only on the numbers of green and red marbles, not on the order in which they appear; i.e., it is anexchangeable distribution. As a result, the probability of drawing a green marble in the draw is[2]
This is anex ante probability—that is, it is based on not knowing the results of the previous draws.
Let and. Then for we can derive the following bounds:[3]
where
is theKullback–Leibler divergence and it is used that.[4]
Note: In order to derive the previous bounds, one has to start by observing that where aredependent random variables with a specific distribution. Because most of the theorems about bounds in sum of random variables are concerned withindependent sequences of them, one has to first create a sequence ofindependent random variables with the same distribution and apply the theorems on. Then, it is proved from Hoeffding[3] that the results and bounds obtained via this process hold for as well.
Ifn is larger thanN/2, it can be useful to apply symmetry to "invert" the bounds, which give you the following:[4][5]
Thehypergeometric test uses the hypergeometric distribution to measure the statistical significance of having drawn a sample consisting of a specific number of successes (out of total draws) from a population of size containing successes. In a test for over-representation of successes in the sample, the hypergeometric p-value is calculated as the probability of randomly drawing or more successes from the population in total draws. In a test for under-representation, the p-value is the probability of randomly drawing or fewer successes.
The test based on the hypergeometric distribution (hypergeometric test) is identical to the corresponding one-tailed version ofFisher's exact test.[6] Reciprocally, the p-value of a two-sided Fisher's exact test can be calculated as the sum of two appropriate hypergeometric tests (for more information see[7]).
The test is often used to identify which sub-populations are over- or under-represented in a sample. This test has a wide range of applications. For example, a marketing group could use the test to understand their customer base by testing a set of known customers for over-representation of various demographic subgroups (e.g., women, people under 30).
Let and.
where is thestandard normal distribution function
The following table describes four distributions related to the number of successes in a sequence of draws:
| With replacements | No replacements | |
|---|---|---|
| Given number of draws | binomial distribution | hypergeometric distribution |
| Given number of failures | negative binomial distribution | negative hypergeometric distribution |
| Multivariate hypergeometric distribution | |||
|---|---|---|---|
| Parameters | |||
| Support | |||
| PMF | |||
| Mean | |||
| Variance | |||
The model of anurn with green and red marbles can be extended to the case where there are more than two colors of marbles. If there areKi marbles of colori in the urn and you taken marbles at random without replacement, then the number of marbles of each color in the sample (k1,k2,...,kc) has the multivariate hypergeometric distribution:
This has the same relationship to themultinomial distribution that the hypergeometric distribution has to the binomial distribution—the multinomial distribution is the "with-replacement" distribution and the multivariate hypergeometric is the "without-replacement" distribution.
The properties of this distribution are given in the adjacent table,[8] wherec is the number of different colors and is the total number of marbles in the urn.
Suppose there are 5 black, 10 white, and 15 red marbles in an urn. If six marbles are chosen without replacement, the probability that exactly two of each color are chosen is

Election audits typically test a sample of machine-counted precincts to see if recounts by hand or machine match the original counts. Mismatches result in either a report or a larger recount. The sampling rates are usually defined by law, not statistical design, so for a legally defined sample sizen, what is the probability of missing a problem which is present inK precincts, such as a hack or bug? This is the probability thatk = 0 . Bugs are often obscure, and a hacker can minimize detection by affecting only a few precincts, which will still affect close elections, so a plausible scenario is forK to be on the order of 5% ofN. Audits typically cover 1% to 10% of precincts (often 3%),[9][10][11] so they have a high chance of missing a problem. For example, if a problem is present in 5 of 100 precincts, a 3% sample has 86% probability thatk = 0 so the problem would not be noticed, and only 14% probability of the problem appearing in the sample (positive k):
The sample would need 45 precincts in order to have probability under 5% thatk = 0 in the sample, and thus have probability over 95% of finding the problem:
Inhold'em poker players make the best hand they can combining the two cards in their hand with the 5 cards (community cards) eventually turned up on the table. The deck has 52 and there are 13 of each suit.For this example assume a player has 2 clubs in the hand and there are 3 cards showing on the table, 2 of which are also clubs. The player would like to know the probability of one of the next 2 cards to be shown being a club to complete theflush.
(Note that the probability calculated in this example assumes no information is known about the cards in the other players' hands; however, experienced poker players may consider how the other players place their bets (check, call, raise, or fold) in considering the probability for each scenario. Strictly speaking, the approach to calculating success probabilities outlined here is accurate in a scenario where there is just one player at the table; in a multiplayer game this probability might be adjusted somewhat based on the betting play of the opponents.)
There are 4 clubs showing so there are 9 clubs still unseen. There are 5 cards showing (2 in the hand and 3 on the table) so there are still unseen.
The probability that one of the next two cards turned is a club can be calculated using hypergeometric with and. (about 31.64%)
The probability that both of the next two cards turned are clubs can be calculated using hypergeometric with and. (about 3.33%)
The probability that neither of the next two cards turned are clubs can be calculated using hypergeometric with and. (about 65.03%)
The hypergeometric distribution is indispensable for calculatingKeno odds. In Keno, 20 balls are randomly drawn from a collection of 80 numbered balls in a container, rather likeAmerican Bingo. Prior to each draw, a player selects a certain number ofspots by marking a paper form supplied for this purpose. For example, a player mightplay a 6-spot by marking 6 numbers, each from a range of 1 through 80 inclusive. Then (after all players have taken their forms to a cashier and been given a duplicate of their marked form, and paid their wager) 20 balls are drawn. Some of the balls drawn may match some or all of the balls selected by the player. Generally speaking, the morehits (balls drawn that match player numbers selected) the greater the payoff.
For example, if a customer bets ("plays") $1 for a 6-spot (not an uncommon example) and hits 4 out of the 6, the casino would pay out $4. Payouts can vary from one casino to the next, but $4 is a typical value here. The probability of this event is:
Similarly, the chance for hitting 5 spots out of 6 selected iswhile a typical payout might be $88. The payout for hitting all 6 would be around $1500 (probability ≈ 0.000128985 or 7752-to-1). The only other nonzero payout might be $1 for hitting 3 numbers (i.e., you get your bet back), which has a probability near 0.129819548.
Taking the sum of products of payouts times corresponding probabilities we get an expected return of 0.70986492 or roughly 71% for a 6-spot, for a house advantage of 29%. Other spots-played have a similar expected return. This very poor return (for the player) is usually explained by the large overhead (floor space, equipment, personnel) required for the game.
This article includes a list ofgeneral references, butit lacks sufficient correspondinginline citations. Please help toimprove this article byintroducing more precise citations.(August 2011) (Learn how and when to remove this message) |