Inmathematical analysis and inprobability theory, aσ-algebra ("sigma algebra") is part of the formalism for definingsets that can be measured. Incalculus andanalysis, for example, σ-algebras are used to define the concept of sets witharea orvolume. In probability theory, they are used to define events with a well-defined probability. In this way, σ-algebras help to formalize the notion ofsize.
In formal terms, a σ-algebra (alsoσ-field, where the σ comes from theGerman "Summe",[1] meaning "sum") on a setX is a nonempty collection Σ ofsubsets ofXclosed undercomplement, countableunions, and countableintersections. The ordered pair is called ameasurable space.
The setX is understood to be an ambient space (such as the 2D plane or the set of outcomes when rolling a six-sided die {1,2,3,4,5,6}), and the collection Σ is a choice of subsets declared to have a well-defined size. The closure requirements for σ-algebras are designed to capture our intuitive ideas about how sizes combine: if there is a well-defined probability that an event occurs, there should be a well-defined probability that it does not occur (closure under complements); if several sets have a well-defined size, so should their combination (countable unions); if several events have a well-defined probability of occurring, so should the event where they all occur simultaneously (countable intersections).
The definition of σ-algebra resembles other mathematical structures such as atopology (which is required to be closed under all unions but only finite intersections, and which doesn't necessarily contain all complements of its sets) or aset algebra (which is closed only underfinite unions and intersections).
If one possible σ-algebra on is where is theempty set. In general, a finite algebra is always a σ-algebra.
If is a countablepartition of then the collection of all unions of sets in the partition (including the empty set) is a σ-algebra.
A more useful example is the set of subsets of thereal line formed by starting with allopen intervals and adding in all countable unions, countable intersections, and relative complements and continuing this process (bytransfinite iteration through allcountable ordinals) until the relevant closure properties are achieved (a construction known as theBorel hierarchy).
There are at least three key motivators for σ-algebras: defining measures, manipulating limits of sets, and managing partial information characterized by sets.
Ameasure on is afunction that assigns a non-negativereal number to subsets of this can be thought of as making precise a notion of "size" or "volume" for sets. We want the size of the union of disjoint sets to be the sum of their individual sizes, even for an infinite sequence ofdisjoint sets.
One would like to assign a size toevery subset of but in many natural settings, this is not possible. For example, theaxiom of choice implies that when the size under consideration is the ordinary notion of length for subsets of the real line, then there exist sets for which no size exists, for example, theVitali sets. For this reason, one considers instead a smaller collection of privileged subsets of These subsets will be called the measurable sets. They are closed under operations that one would expect for measurable sets, that is, the complement of a measurable set is a measurable set and the countable union of measurable sets is a measurable set. Non-empty collections of sets with these properties are called σ-algebras.
Many uses of measure, such as the probability concept ofalmost sure convergence, involvelimits of sequences of sets. For this, closure under countable unions and intersections is paramount. Set limits are defined as follows on σ-algebras.
The inner limit is always a subset of the outer limit: If these two sets are equal then their limit exists and is equal to this common set:
In much of probability, especially whenconditional expectation is involved, one is concerned with sets that represent only part of all the possible information that can be observed. This partial information can be characterized with a smaller σ-algebra which is a subset of the principal σ-algebra; it consists of the collection of subsets relevant only to and determined only by the partial information. Formally, if are σ-algebras on, then is a sub σ-algebra of if.
TheBernoulli process provides a simple example. This consists of a sequence of random coin flips, coming up Heads () or Tails (), of unbounded length. Thesample space Ω consists of all possible infinite sequences of or
The full sigma algebra can be generated from an ascending sequence of subalgebras, by considering the information that might be obtained after observing some or all of the first coin flips. This sequence of subalgebras is given byEach of these is finer than the last, and so can be ordered as afiltration
The first subalgebra is the trivial algebra: it has only two elements in it, the empty set and the total space. The second subalgebra has four elements: the two in plus two more: sequences that start with and sequences that start with. Each subalgebra is finer than the last. The'th subalgebra contains elements: it divides the total space into all of the possible sequences that might have been observed after flips, including the possible non-observation of some of the flips.
The limiting algebra is the smallest σ-algebra containing all the others. It is the algebra generated by theproduct topology orweak topology on the product space
Let be some set, and let represent itspower set, the set of all subsets of. Then a subset is called aσ-algebra if and only if it satisfies the following three properties:[2]
From these properties, it follows that the σ-algebra is also closed under countableintersections (by applyingDe Morgan's laws).
It also follows that theempty set is in since by(1) is in and(2) asserts that its complement, the empty set, is also in Moreover, since satisfies all 3 conditions, it follows that is the smallest possible σ-algebra on The largest possible σ-algebra on is
Elements of the σ-algebra are calledmeasurable sets. An ordered pair where is a set and is a σ-algebra over is called ameasurable space. A function between two measurable spaces is called ameasurable function if thepreimage of every measurable set is measurable. The collection of measurable spaces forms acategory, with themeasurable functions asmorphisms.Measures are defined as certain types of functions from a σ-algebra to
A σ-algebra is both aπ-system and aDynkin system (λ-system). The converse is true as well, by Dynkin's theorem (see below).
This theorem (or the relatedmonotone class theorem) is an essential tool for proving many results about properties of specific σ-algebras. It capitalizes on the nature of two simpler classes of sets, namely the following.
Dynkin's π-λ theorem says, if is a π-system and is a Dynkin system that contains then the σ-algebragenerated by is contained in Since certain π-systems are relatively simple classes, it may not be hard to verify that all sets in enjoy the property under consideration while, on the other hand, showing that the collection of all subsets with the property is a Dynkin system can also be straightforward. Dynkin's π-λ Theorem then implies that all sets in enjoy the property, avoiding the task of checking it for an arbitrary set in
One of the most fundamental uses of the π-λ theorem is to show equivalence of separately defined measures or integrals. For example, it is used to equate a probability for a random variable with theLebesgue-Stieltjes integral typically associated with computing the probability: for all in the Borel σ-algebra onwhere is thecumulative distribution function for defined on while is aprobability measure, defined on a σ-algebra of subsets of somesample space
Suppose is a collection of σ-algebras on a space
Meet
The intersection of a collection of σ-algebras is a σ-algebra. To emphasize its character as a σ-algebra, it often is denoted by:
Sketch of Proof: Let denote the intersection. Since is in every is not empty. Closure under complement and countable unions for every implies the same must be true for Therefore, is a σ-algebra.
Join
The union of a collection of σ-algebras is not generally a σ-algebra, or even an algebra, but itgenerates a σ-algebra known as the join which typically is denotedA π-system that generates the join isSketch of Proof: By the case it is seen that each soThis impliesby the definition of a σ-algebragenerated by a collection of subsets. On the other hand,which, by Dynkin's π-λ theorem, implies
Suppose is a subset of and let be a measurable space.
Aσ-algebra is just aσ-ring that contains the universal set[3] Aσ-ring need not be aσ-algebra, as for example measurable subsets of zero Lebesgue measure in the real line are aσ-ring, but not aσ-algebra since the real line has infinite measure and thus cannot be obtained by their countable union. If, instead of zero measure, one takes measurable subsets of finite Lebesgue measure, those are aring but not aσ-ring, since the real line can be obtained by their countable union yet its measure is not finite.
σ-algebras are sometimes denoted usingcalligraphic capital letters, or theFraktur typeface. Thus may be denoted as or
Aseparable-algebra (orseparable-field) is a-algebra that is aseparable space when considered as ametric space withmetric for and a given finitemeasure (and with being thesymmetric difference operator).[4] Any-algebra generated by acountable collection ofsets is separable, but the converse need not hold. For example, the Lebesgue-algebra is separable (since every Lebesgue measurable set is equivalent to some Borel set) but not countably generated (since its cardinality is higher than continuum).
A separable measure space has a naturalpseudometric that renders itseparable as apseudometric space. The distance between two sets is defined as the measure of thesymmetric difference of the two sets. The symmetric difference of two distinct sets can have measure zero; hence the pseudometric as defined above need not to be a true metric. However, if sets whose symmetric difference has measure zero are identified into a singleequivalence class, the resultingquotient set can be properly metrized by the induced metric. If the measure space is separable, it can be shown that the corresponding metric space is, too.
Let be any set.
Astopping time can define a-algebra theso-calledstopping time sigma-algebra, which in afiltered probability space describes the information up to the random time in the sense that, if the filtered probability space is interpreted as a random experiment, the maximum information that can be found out about the experiment from arbitrarily often repeating it until the time is[5]
Let be an arbitrary family of subsets of Then there exists a unique smallest σ-algebra which contains every set in (even though may or may not itself be a σ-algebra). It is, in fact, the intersection of all σ-algebras containing (See intersections of σ-algebras above.) This σ-algebra is denoted and is calledthe σ-algebra generated by
If is empty, then Otherwise consists of all the subsets of that can be made from elements of by a countable number of complement, union and intersection operations.
For a simple example, consider the set Then the σ-algebra generated by the single subset is By anabuse of notation, when a collection of subsets contains only one element, may be written instead of in the prior example instead of Indeed, using to mean is also quite common.
There are many families of subsets that generate useful σ-algebras. Some of these are presented here.
If is a function from a set to a set and is a-algebra of subsets of then the-algebra generated by the function denoted by is the collection of all inverse images of the sets in That is,
A function from a set to a set ismeasurable with respect to a σ-algebra of subsets of if and only if is a subset of
One common situation, and understood by default if is not specified explicitly, is when is ametric ortopological space and is the collection ofBorel sets on
If is a function from to then is generated by the family of subsets which are inverse images of intervals/rectangles in
A useful property is the following. Assume is a measurable map from to and is a measurable map from to If there exists a measurable map from to such that for all then If is finite or countably infinite or, more generally, is astandard Borel space (for example, a separable complete metric space with its associated Borel sets), then the converse is also true.[6] Examples of standard Borel spaces include with its Borel sets and with the cylinder σ-algebra described below.
An important example is theBorel algebra over anytopological space: the σ-algebra generated by theopen sets (or, equivalently, by theclosed sets). This σ-algebra is not, in general, the whole power set. For a non-trivial example that is not a Borel set, see theVitali set orNon-Borel sets.
On theEuclidean space another σ-algebra is of importance: that of allLebesgue measurable sets. This σ-algebra contains more sets than the Borel σ-algebra on and is preferred inintegration theory, as it gives acomplete measure space.
Let and be two measurable spaces. The σ-algebra for the correspondingproduct space is called theproduct σ-algebra and is defined by
Observe that is a π-system.
The Borel σ-algebra for is generated by half-infinite rectangles and by finite rectangles. For example,
For each of these two examples, the generating family is a π-system.
Suppose
is a set of real-valued functions. Let denote the Borel subsets of Acylinder subset of is a finitely restricted set defined as
Eachis a π-system that generates a σ-algebra Then the family of subsetsis an algebra that generates thecylinder σ-algebra for This σ-algebra is a subalgebra of the Borel σ-algebra determined by theproduct topology of restricted to
An important special case is when is the set of natural numbers and is a set of real-valued sequences. In this case, it suffices to consider the cylinder setsfor whichis a non-decreasing sequence of σ-algebras.
The ball σ-algebra is the smallest σ-algebra containing all the open (and/or closed) balls. This is never larger than theBorel σ-algebra. Note that the two σ-algebra are equal for separable spaces. For some nonseparable spaces, some maps are ball measurable even though they are not Borel measurable, making use of the ball σ-algebra useful in the analysis of such maps.[7]
Suppose is aprobability space. If is measurable with respect to the Borel σ-algebra on then is called arandom variable () orrandom vector (). The σ-algebra generated by is
Suppose is aprobability space and is the set of real-valued functions on If is measurable with respect to the cylinder σ-algebra (see above) for then is called astochastic process orrandom process. The σ-algebra generated by isthe σ-algebra generated by the inverse images of cylinder sets.
Families of sets over | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Is necessarily true of or, isclosed under: | Directed by | F.I.P. | ||||||||
π-system | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() |
Semiring | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
Semialgebra(Semifield) | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
Monotone class | ![]() | ![]() | ![]() | ![]() | ![]() | only if | only if | ![]() | ![]() | ![]() |
𝜆-system(Dynkin System) | ![]() | ![]() | ![]() | only if | ![]() | ![]() | only if or they aredisjoint | ![]() | ![]() | Never |
Ring(Order theory) | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() |
Ring(Measure theory) | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
δ-Ring | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
𝜎-Ring | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
Algebra(Field) | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
𝜎-Algebra(𝜎-Field) | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | Never |
Dual ideal | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() |
Filter | ![]() | ![]() | ![]() | Never | Never | ![]() | ![]() | ![]() | ![]() | |
Prefilter(Filter base) | ![]() | ![]() | ![]() | Never | Never | ![]() | ![]() | ![]() | ![]() | |
Filter subbase | ![]() | ![]() | ![]() | Never | Never | ![]() | ![]() | ![]() | ![]() | |
Open Topology | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() (even arbitrary) | ![]() | ![]() | Never |
Closed Topology | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() (even arbitrary) | ![]() | ![]() | ![]() | Never |
Is necessarily true of or, isclosed under: | directed downward | finite intersections | finite unions | relative complements | complements in | countable intersections | countable unions | contains | contains | Finite Intersection Property |
Additionally, asemiring is aπ-system where every complement is equal to a finitedisjoint union of sets in |
If is a Borel measure on the measure algebra of is the Boolean algebra of all Borel sets modulo-null sets. If is finite, then such a measure algebra is also a metric space, with the distance between the two sets being the measure of their symmetric difference. Then, we say that isseparableif and only if this metric space is separable as a topological space.