Joint characteristic function

byMarco Taboga, PhD

The joint characteristic function (joint cf) of arandom vector is a multivariate generalization of thecharacteristic function of arandom variable.

Table of Contents

Table of contents

Definition

Here is a definition.

Definition Let be a Kx1 random vector. Thejoint characteristic function of is a function [eq1] defined by [eq2] where $i=sqrt{-1}$ is the imaginary unit.

Observe that [eq3] exists for any $tin U{211d} ^{K}$ because [eq4] and the expected values appearing in the last line are well-defined, because both the sine and the cosine are bounded (they take values in the interval [eq5] ).

Deriving cross-moments

Like thejoint moment generating function of a random vector, the joint cf can be used to derive thecross-moments of, as stated below.

Proposition Let be a random vector and [eq6] its joint characteristic function. Let $nin U{2115} $ . Define a cross-moment of order as follows: [eq7] where [eq8] and [eq9] . If all cross-moments of order exist and are finite, then all the-th order partial derivatives of [eq10] exist and [eq11] where the partial derivative on the right-hand side of the equation is evaluated at the point $t_{1}=0$ , $t_{2}=0$ , ..., $t_{K}=0$ .

Proof

SeeUshakov (1999).

When we need to derive a cross-moment of a random vector, the practical usefulness of this proposition is somewhat limited, because it is seldom known, a priori, whether cross-moments of a given order exist or not.

The following proposition, instead, does not require such a priori knowledge.

Proposition Let be a random vector and [eq12] its joint cf. If all the-th order partial derivatives of [eq13] exist, then

if iseven, for any all-th cross-moments of exist and are finite;
if isodd, for any all-th cross-moments of exist and are finite.

In both cases, we have that [eq16] where the partial derivatives on the right-hand sides of the equations above are evaluated at the point $t_{1}=0$ , $t_{2}=0$ , ..., $t_{K}=0$ .

Proof

Again, seeUshakov (1999).

Characterizing joint distributions

The joint cf can also be used to check whether two random vectors have the same distribution.

PropositionLet and be two Kx1 random vectors. Denote by [eq17] and [eq18] theirjoint distribution functions and by [eq19] and [eq20] their joint cfs. Then, [eq21]

Proof

The proof can be found inUshakov (1999).

Stated differently, two random vectors have the same distribution if and only if they have the same joint cf.

This result is frequently used in applications because demonstrating equality of two joint cfs is often much easier than demonstrating equality of two joint distribution functions.

More details

The following sections contain more detail about the joint characteristic function.

Joint cf of a linear transformation

Let be a Kx1 random vector with characteristic function [eq22] .

Define [eq23] where is a $Limes 1$ constant vector and $B$ is a $Limes K$ constant matrix.

Then, the joint cf of is [eq24]

Proof

This is proved as follows: [eq25]

Joint cf of a random vector withindependent entries

Let be a Kx1 random vector.

Let its entries X_1 , ..., $X_{K}$ bemutually independent random variables.

Denote the cf of the $j$ -th entry of by [eq26] .

Then, the joint cf of is [eq27]

Proof

This is demonstrated as follows: [eq28]

Joint cf of a sum of mutuallyindependent random vectors

Let X_1 , ..., X_n be mutually independent random vectors.

Let be their sum: [eq29]

Then, the joint cf of is the product of the joint cfs of X_1 , ..., X_n : [eq30]

Proof

Similar to the previous proof: [eq31]

Solved exercises

Some solved exercises on joint characteristic functions can be found below.

Exercise 1

Let $Z_{1}$ and $Z_{2}$ be two independentstandard normal random variables.

Let be a $2imes 1$ random vector whose components are defined as follows: [eq32]

Derive the joint characteristic function of.

Hint: use the fact that $Z_{1}^{2}$ and $Z_{2}^{2}$ are two independentChi-square random variables having characteristic function [eq33]

Solution

By using the definition of characteristic function, we get [eq34]

Exercise 2

Use the joint characteristic function found in the previous exercise to derive the expected value and the covariance matrix of.

Solution

We need to compute the partial derivatives of the joint characteristic function: [eq35] All partial derivatives up to the second order exist and are well defined. As a consequence, all cross-moments up to the second order exist and are finite and they can be computed from the above partial derivatives: [eq36] The covariances are derived as follows: [eq37] So, summing up, we get [eq38]

Exercise 3

Read and try to understand how the joint characteristic function of the multinomial distribution is derived in the lecture entitledMultinomial distribution.

References

Ushakov, N. G. (1999)Selected topics in characteristic functions, VSP.

How to cite

Please cite as:

Taboga, Marco (2021). "Joint characteristic function", Lectures on probability theory and mathematical statistics. Kindle Direct Publishing. Online appendix. https://www.statlect.com/fundamentals-of-probability/joint-characteristic-function.

Movatterモバイル変換

Joint characteristic function

Definition

Deriving cross-moments

Characterizing joint distributions

More details

Joint cf of a linear transformation

Joint cf of a random vector withindependent entries

Joint cf of a sum of mutuallyindependent random vectors

Solved exercises

Exercise 1

Exercise 2

Exercise 3

References

How to cite