This articleneeds additional citations forverification. Please helpimprove this article byadding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "Ecological fallacy" – news ·newspapers ·books ·scholar ·JSTOR(March 2016) (Learn how and when to remove this message)

Anecological fallacy (alsoecologicalinference fallacy^[1] orpopulation fallacy) is aformal fallacy in the interpretation ofstatistical data that occurs wheninferences about the nature of individuals are deduced from inferences about the group to which those individuals belong. "Ecological fallacy" is a term that is sometimes used to describe thefallacy of division, which is not a statistical fallacy. The four common statistical ecological fallacies are: confusion between ecological correlations and individual correlations, confusion between group average and total average,Simpson's paradox, and confusion between higher average and higher likelihood. From a statistical point of view, these ideas can be unified by specifying proper statistical models to make formal inferences, using aggregate data to make unobserved relationships in individual level data.^[2]

This sectiondoes notcite anysources. Please helpimprove this section byadding citations to reliable sources. Unsourced material may be challenged andremoved.(September 2025) (Learn how and when to remove this message)

An example of ecological fallacy is the assumption that a population mean has a simple interpretation when considering likelihoods for an individual.

For instance, if the mean score of a group is larger than zero, this does not imply that a random individual of that group is more likely to have a positive score than a negative one (as long as there are more negative scores than positive scores an individual is more likely to have a negative score). Similarly, if a particular group of people is measured to have a lower mean IQ than the general population, it is an error to conclude that a randomly-selected member of the group is more likely than not to have a lower IQ than the mean IQ of the general population; it is also not necessarily the case that a randomly selected member of the group is more likely than not to have a lower IQ than a randomly-selected member of the general population. Mathematically, this comes from the fact that a distribution can have a positive mean but a negative median. This property is linked to theskewness of the distribution.

Consider the following numerical example:

• Group A: 80% of people got 40 points and 20% of them got 95 points. The mean score is 51 points.
• Group B: 50% of people got 45 points and 50% got 55 points. The mean score is 50 points.
• If we pick two people at random from A and B, there are 4 possible outcomes:
  • A – 40, B – 45 (B wins, 40% probability – 0.8 × 0.5)
  • A – 40, B – 55 (B wins, 40% probability – 0.8 × 0.5)
  • A – 95, B – 45 (A wins, 10% probability – 0.2 × 0.5)
  • A – 95, B – 55 (A wins, 10% probability – 0.2 × 0.5)
• Although Group A has a higher mean score, 80% of the time a random individual of A will score lower than a random individual of B.

Research dating back toÉmile Durkheim suggests that predominantlyProtestant localities have highersuicide rates than predominantlyCatholic localities.^[3] According to Freedman,^[4] the idea that Durkheim's findings link, at an individual level, a person's religion to their suicide risk is an example of the ecological fallacy. A group-level relationship does not automatically characterize the relationship at the level of the individual.

Similarly, even if at the individual level,wealth is positively correlated to tendency to voteRepublican in theUnited States, we observe that wealthier states tend to voteDemocratic. For example, in the2004 United States presidential election, the Republican candidate,George W. Bush, won the fifteen poorest states, and the Democratic candidate,John Kerry, won 9 of the 11 wealthiest states in theElectoral College. Yet 62% of voters with annual incomes over $200,000 voted for Bush, but only 36% of voters with annual incomes of $15,000 or less voted for Bush.^[5]Aggregate-level correlation will differ from individual-level correlation if voting preferences are affected by the total wealth of the state even after controlling for individual wealth. The true driving factor in voting preference could be self-perceivedrelative wealth; perhaps those who see themselves as better off than their neighbours are more likely to vote Republican. In this case, an individual would be more likely to vote Republican if they became wealthier, but they would be more likely to vote for a Democrat if their neighbor's wealth increased (resulting in a wealthier state).

However, the observed difference in voting habits based on state- and individual-level wealth could also be explained by the common confusion between higher averages and higher likelihoods as discussed above. States may not be wealthier because they contain more wealthy people (i.e., more people with annual incomes over $200,000), but rather because they contain a small number of super-rich individuals; the ecological fallacy then results from incorrectly assuming that individuals in wealthier states are more likely to be wealthy.

Many examples of ecological fallacies can be found in studies of social networks, which often combine analysis and implications from different levels. This has been illustrated in an academic paper on networks of farmers inSumatra.^[6]

A 1950 paper by William S. Robinson computed the illiteracy rate and the proportion of the population born outside the US for each state and for the District of Columbia, as of the1930 census.^[7] He showed that these two figures were associated with a negative correlation of −0.53; in other words, the greater the proportion of immigrants in a state, the lower its average illiteracy (or, equivalently, the higher its average literacy). However, when individuals are considered, the correlation between illiteracy and nativity was +0.12 (immigrants were on average more illiterate than native citizens). Robinson showed that the negative correlation at the level of state populations was because immigrants tended to settle in states where the native population was more literate. He cautioned against deducing conclusions about individuals on the basis of population-level, or "ecological" data. In 2011, it was found that Robinson's calculations of the ecological correlations are based on the wrong state level data. The correlation of −0.53 mentioned above is in fact −0.46.^[8] Robinson's paper was seminal, but the term 'ecological fallacy' was not coined until 1958 by Selvin.^[9]

This sectiondoes notcite anysources. Please helpimprove this section byadding citations to reliable sources. Unsourced material may be challenged andremoved.(September 2025) (Learn how and when to remove this message)

The correlation of aggregate quantities (orecological correlation) is not equal to the correlation of individual quantities. Denote byX_i, Y_i two quantities at the individual level. The formula for the covariance of the aggregate quantities in groups of sizeN is

${\displaystyle \mathrm{cov}\left(\sum _{i=1}^N{Y}_i,\sum _{i=1}^N{X}_i\right)=\sum _{i=1}^N\mathrm{cov}(Y_i,X_i)+\sum _{i=1}^N\sum _{l\ne i}\mathrm{cov}(Y_l,X_i)}$

The covariance of two aggregated variables depends not only on the covariance of two variables within the same individuals but also on covariances of the variables between different individuals. In other words, correlation of aggregate variables take into account cross sectional effects which are not relevant at the individual level.

The problem for correlations entails naturally a problem for regressions on aggregate variables: the correlation fallacy is therefore an important issue for a researcher who wants to measure causal impacts. Start with a regression model where the outcome${\displaystyle Y_i}$ is impacted by${\displaystyle X_i}$

${\displaystyle Y_i=\alpha +\beta X_i+u_i,}$

${\displaystyle \mathrm{cov}[u_i,X_i]=0.}$

The regression model at the aggregate level is obtained by summing the individual equations:

${\displaystyle \sum _{i=1}^N{Y}_i=\alpha \cdot N+\beta \sum _{i=1}^N{X}_i+\sum _{i=1}^N{u}_i,}$

${\displaystyle \mathrm{cov}\left[\sum _{i=1}^N{u}_i,\sum _{i=1}^N{X}_i\right]\ne 0.}$

Nothing prevents the regressors and the errors from being correlated at the aggregate level. Therefore, generally, running a regression on aggregate data does not estimate the same model than running a regression with individual data.

The aggregate model is correct if and only if

${\displaystyle \mathrm{cov}\left[u_i,\sum _{k=1}^N{X}_k\right]=0\text{ for all }i.}$

This means that, controlling for${\displaystyle X_i}$,${\displaystyle \sum _{k=1}^N{X}_k}$ does not determine${\displaystyle Y_i}$.

Running regressions on aggregate data can yield valid (unbiased, under the usual identification assumptions) estimates when the target of inference is the aggregate model. For example, for state-level policy analysis, estimating the relationship between police force and crime using state-level data is appropriate for assessing the effect of a statewide change in police staffing. By contrast, inferring city-level impacts from state-level associations constitutes an ecological fallacy, since parameters estimated at the aggregate level need not identify effects at finer geographic units.

Choosing to run aggregate or individual regressions to understand aggregate impacts on some policy depends on the following trade-off: aggregate regressions lose individual-level data but individual regressions add strong modeling assumptions. Some researchers suggest that the ecological correlation gives a better picture of the outcome of public policy actions, thus they recommend the ecological correlation over the individual level correlation for this purpose.^[10] Other researchers disagree, especially when the relationships among the levels are not clearly modeled. To prevent ecological fallacy, researchers with no individual data can model first what is occurring at the individual level, then model how the individual and group levels are related, and finally examine whether anything occurring at the group level adds to the understanding of the relationship. For instance, in evaluating the impact of state policies, it is helpful to know that policy impacts vary less among the states than do the policies themselves, suggesting that the policy differences are not well translated into results, despite high ecological correlations.^[11]

This sectiondoes notcite anysources. Please helpimprove this section byadding citations to reliable sources. Unsourced material may be challenged andremoved.(September 2025) (Learn how and when to remove this message)

Ecological fallacy can also refer to the following fallacy: the average for a group is approximated by the average in the total population divided by the group size. Suppose one knows the number of Protestants and the suicide rate in the US, but one does not have data linking religion and suicide at the individual level. If one is interested in the suicide rate of Protestants, it is a mistake to estimate it by the total suicide rate divided by the number of Protestants.Formally, denote${\displaystyle P[\text{Suicide}\mid \text{Protestant}]}$ the mean of the group, we generally have:

${\displaystyle P[\text{Suicide}\mid \text{Protestant}]\ne \frac{P[\text{Suicide}]}{P(\text{Protestant})}}$

However, thelaw of total probability gives

${\displaystyle \begin{array}{r}P[\text{Suicide}]=P[\text{Suicide}\mid \text{Protestant}]P(\text{Protestant})+P[\text{Suicide}\mid \text{not Protestant}](1-P(\text{Protestant}))\end{array}}$

As we know that${\displaystyle P[\text{Suicide}\mid \text{not Protestant}]}$ is between 0 and 1, this equation gives a bound for${\displaystyle P[\text{Suicide}\mid \text{Protestant}]}$.

This sectiondoes notcite anysources. Please helpimprove this section byadding citations to reliable sources. Unsourced material may be challenged andremoved.(September 2025) (Learn how and when to remove this message)

Simpson's paradox is an ecological fallacy:^[12] when comparing two populations divided into groups, the average of some variable in the first population can be higher in every group and yet lower in the total population. Formally, when each value ofZ refers to a different group andX refers to some treatment, it can happen that

When${\displaystyle E[Y\mid Z=z,X=1]-E[Y\mid Z=z,X=0]}$ does not depend on${\displaystyle Z}$, the Simpson's paradox is exactly theomitted variable bias for the regression ofY onX where the regressor${\displaystyle X}$ is adummy variable and the omitted variable${\displaystyle Z}$ is acategorical variable defining groups for each value it takes. The bias can be high enough for conditional and unconditional effects to have opposite signs.

The ecological fallacy was discussed in a court challenge to the2004 Washington gubernatorial election in which a number of illegal voters were identified, after the election; their votes were unknown, because the vote was bysecret ballot. The challengers argued that illegal votes cast in the election would have followed the voting patterns of the precincts in which they had been cast, and thus adjustments should be made accordingly.^[13] An expert witness said this approach was like trying to figure outIchiro Suzuki's batting average by looking at the batting average of the entireSeattle Mariners team, since the illegal votes were cast by an unrepresentative sample of each precinct's voters, and might be as different from the average voter in the precinct as Ichiro was from the rest of his team.^[14] The judge determined that the challengers' argument was an ecological fallacy and rejected it.^[15]

• Problems in spatial analysis
• Misuse of statistics
• Formal fallacies

• Webarchive template wayback links
• Articles with short description
• Short description is different from Wikidata
• Articles needing additional references from March 2016
• All articles needing additional references
• Articles needing additional references from September 2025