Given a random variable that follows a multivariate normal distribution, the projected normal distribution represents the distribution of the random variable obtained projecting over the unit sphere. In the general case, the projected normal distribution can be asymmetric andmultimodal. In case is parallel to aneigenvector of, the distribution is symmetric.[3] The first version of such distribution was introduced in Pukkila and Rao (1988).[4]
The support of this distribution is the unit (n-1)-sphere, which can be variously given in terms of a set of-dimensionalangular spherical cooordinates:
Infull spherical coordinates with radial component and angles, a point can be written as, with. To be clear,, as given by the above-defined embedding function. The joint density becomes
where the factor is due to thechange of variables. The density of can then be obtained via marginalization over as[5]
The same density had been previously obtained in Pukkila and Rao (1988, Eq. (2.4))[4] using a different notation.
This subsection gives some clarification lest the various forms ofprobability density used in this article be misunderstood. Take for example a random variate, with uniform density,. If, it has density,. This works if both densities are defined with respect toLebesgue measure on the real line. By default convention:
Density functions areLebesgue-densities, definedwith respect to Lebesgue measure, applied in the space where the argument of the density function lives, so that:
The Lebesgue-densities involved in achange of variables are related by a factor dependent on the derivative(s) of the transformation ( in this example; and for the above change of variables,).
Neither of these conventions apply to the densities in this article:
For the density, isnot defined w.r.t. Lebesgue measure in where lives, because that measure does not agree with the standard notion ofhyperspherical area. Instead, thedensity is defined w.r.t. a measure that ispulled back (via the embedding function) to angular coordinate space, from Lebesgue measure in the-dimensionaltangent space of the hypersphere. This will be explained below.
With the embedding, a density, cannot be defined w.r.t. Lebesgue measure, because has Lebesgue measure zero. Instead, is defined w.r.t.scaled Hausdorff measure.
The pullback and Hausdorff measures agree, so that:
where there is no change-of-variables factor, because the densities usedifferent measures.
To better understand what is meant by a density being defined w.r.t. ameasure (a function that maps subsets insample space to a non-negative real-valued 'volume'), consider a measureable subset,, with embedded image and let, then the probability for finding the sample in the subset is:
where are respectively the pullback and Hausdorff measures; and the integrals areLebesgue integrals, which can berewritten as Riemann integrals thus:
Thetangent space at is the-dimensionallinear subspace perpendicular to, where Lebesgue measurecan be used. At very small scale, the tangent space is indistinguishable from the sphere (e.g. Earth looks locally flat), so that Lebesgue measure in tangent space agrees with area on the hypersphere. The tangent space Lebesgue measure is pulled back via the embedding function, as follows, to define the measure in coordinate space. For a measureable subset in coordinate space, thepullback measure, as aRiemann integral is:
where theJacobian of the embedding function,, is the matrix the columns of which span the-dimensional tangent space where the Lebesgue measure is applied.It can be shown: When plugging the pullback measure (2), into equation (1) and exchanging the order of integration:[6]
where the first integral is Lebesgue and the second Riemann. Finally, for better geometric understanding of the square-root factor, consider:
For, when integrating over the unitcircle, w.r.t., with embedding, the Jacobian is, so that. The angular differential, directly gives the subtended arc length on the circle.
For, when integrating over the unitsphere, w.r.t., we get, which is the radius of thecircle of latitude at (compare equator to polar circle). The area of the surface patch subtended by the two angular differentials is:.
More generally, for, let be a square or tall matrix and let denote theparallelotope spanned by its colums (which represent the edges meeting at a common vertex). The parallelotope volume is the square root of the absolute value of theGram determinant. For square, the volume simplifies to Now let, so that is a rectangle with infinitessimally small volume,. Since the smooth embedding function is linear at small scale, the embedded image is the paralleotope,, with volume (area of the subtended hyperspherical surface patch):
For, parametrising the position on theunit circle inpolar coordinates as, the density function can be written with respect to the parameters and of the initial normal distribution as
In the circular case, if the mean vector is parallel to theeigenvector associated to the largesteigenvalue of the covariance, the distribution is symmetric and has amode at and either a mode or an antimode at, where is the polar angle of. If the mean is parallel to the eigenvector associated to the smallest eigenvalue instead, the distribution is also symmetric but has either a mode or an antimode at and an antimode at.[7]
For, parametrising the position on theunit sphere inspherical coordinates as where are theazimuth and inclination angles respectively, the density function becomes
where,,, and have the same meaning as the circular case.[8]
In the special case,, the projected normal distribution, with is known as theangular central Gaussian (ACG)[9] and in this case, the density function can be obtained in closed form as a function ofCartesian coordinates. Let and project radially: so that (the unit hypersphere). We write, which as explained above, at, has density:
where the integral can be solved by a change of variables and then using the standard definition of thegamma function. Notice that:
which shows that the ACG distributionalso results from applying, to uniform variates, thenormalized linear transform:[9]
Some further explanation of these two ways to obtain may be helpful:
If we start with, sampled from a multivariate normal, we can project radially onto to obtain ACG variates. To derive the ACG density, we first do a change of variables:, which is still an-dimensional representation, and this transformation induces the differential volume change factor,, which is proportional to volume in the-dimensionaltangent space perpendicular to. Then, to finally obtain the ACG density on the-dimensional unitsphere, we need to marginalize over.
If we start with, sampled from the uniform distribution, we do not need to marginalize, because we are already in dimensions. Instead, to obtain ACG variates (and the associated density), we can directly do the change of variables,, for which further details are given in the next subsection.
Caveat: when is nonzero, although, a similar duality doesnot hold:
Although we can radially project affine-transformed normal variates to get variates, this does not work for uniform variates.
Wider application of the normalized linear transform
The normalized linear transform,, is abijection from the unitsphere to itself; the inverse is. This transform is of independent interest, as it may be applied as aprobabilistic flow on the hypersphere (similar to anormalizing flow) to generalize also other (non-uniform) distributions on hyperspheres, for example theVon Mises-Fisher distribution. The fact that we have a closed form for the ACG density allows us to recover also in closed form thedifferential volume change induced by this transform.
For the change of variables, on themanifold,, the uniform and ACG densities are related as:[6]
where the (constant) uniform density is and where is the differential volume change factor from the input to the output of the transformation; specifically, it is given by the absolute value of thedeterminant of an-by- matrix:
where is the-by-Jacobian matrix of thetransformation in Euclidean space,, evaluated at. InEuclidean space, the transformation and its Jacobian are non-invertible, but when the domain and co-domain are restricted to, then is a bijection and the induced differential volume ratio, is obtained by projecting onto the-dimensional tangent spaces at the transformation input and output: are-by- matrices whose orthonormal columns span the tangent spaces. Although the above determinant formula is relatively easy to evaluate numerically on a software platform equipped withlinear algebra andautomatic differentiation, a simple closed form is hard to derive directly. However, since we already have, we can recover:
where in the final RHS it is understood that and.
The normalized linear transform can now be used, for example, to give a closed-form density for a more flexible distribution on the hypersphere, that is generalized from theVon Mises-Fisher. Let and; the resulting density is:
Pukkila, Tarmo M.; Rao, C. Radhakrishna (1988). "Pattern recognition based on scale invariant discriminant functions".Information Sciences.45 (3):379–389.doi:10.1016/0020-0255(88)90012-6.
Tyler, David E (1987). "Statistical analysis for the angular central Gaussian distribution on the sphere".Biometrika.74 (3):579–589.doi:10.2307/2336697.JSTOR2336697.
Sorrenson, Peter; Draxler, Felix; Rousselot, Armand; Hummerich, Sander; Köthe, Ullrich (2024). "Learning Distributions on Manifolds with Free-Form Flows".arXiv:2312.09852 [cs.LG].