In appliedstatistics, avariance-stabilizing transformation is adata transformation that is specifically chosen either to simplify considerations in graphicalexploratory data analysis or to allow the application of simple regression-based oranalysis of variance techniques.[1]
The aim behind the choice of a variance-stabilizing transformation is to find a simple functionƒ to apply to valuesx in a data set to create new valuesy =ƒ(x) such that the variability of the valuesy is not related to their mean value. For example, suppose that the values x are realizations from differentPoisson distributions: i.e. the distributions each have different mean valuesμ. Then, because for the Poisson distribution the variance is identical to the mean, the variance varies with the mean. However, if the simple variance-stabilizing transformation
is applied, the sampling variance associated with observation will be nearly constant: seeAnscombe transform for details and some alternative transformations.
While variance-stabilizing transformations are well known for certain parametric families of distributions, such as the Poisson and thebinomial distribution, some types of data analysis proceed more empirically: for example by searching amongpower transformations to find a suitable fixed transformation. Alternatively, if data analysis suggests a functional form for the relation between variance and mean, this can be used to deduce a variance-stabilizing transformation.[2] Thus if, for a meanμ,
a suitable basis for a variance stabilizing transformation would be
where the arbitrary constant of integration and an arbitrary scaling factor can be chosen for convenience.
IfX is a positiverandom variable and for some constant, s, the variance is given ash(μ) =s2μ2 then the standard deviation is proportional to the mean, which is called fixedrelative error. In this case, the variance-stabilizing transformation is
That is, the variance-stabilizing transformation is the logarithmic transformation.
If the variance is given ash(μ) =σ2 +s2μ2 then the variance is dominated by a fixed varianceσ2 when|μ| is small enough and is dominated by the relative variances2μ2 when|μ| is large enough. In this case, the variance-stabilizing transformation is
That is, the variance-stabilizing transformation is theinverse hyperbolic sine of the scaled valuex /λ forλ =σ /s.
TheFisher transformation is a variance stabilizing transformation for thepearson correlation coefficient.
Here the delta method is presented informally to show the link to variance-stabilizing transformations. For a more formal statement of the delta method, seeDelta method.
Let be a random variable, with and.Define, where is a regular function. A first order Taylor approximation for is:
From the equation above, we obtain:
This approximation method is called delta method.
Consider now a random variable such that and.Notice the relation between the variance and the mean, which implies, for example,heteroscedasticity in a linear model. Therefore, the goal is to find a function such that has a variance independent (at least approximately) of its expectation.
Imposing the condition, this equality implies the differential equation:
This ordinary differential equation has, byseparation of variables, the following solution:
This last expression appeared for the first time in aM. S. Bartlett paper.[3]