Lp spaces form an important class ofBanach spaces infunctional analysis, and oftopological vector spaces. Because of their key role in the mathematical analysis of measure and probability spaces, Lebesgue spaces are used also in the theoretical discussion of problems in physics, statistics, economics, finance, engineering, and other disciplines.
Illustrations ofunit circles (see alsosuperellipse) in based on different-norms (every vector from the origin to the unit circle has a length of one, the length being calculated with length-formula of the corresponding).
The Euclidean distance between two points and is the length of the straight line between the two points. In many situations, the Euclidean distance is appropriate for capturing the actual distances in a given space. In contrast, consider taxi drivers in a grid street plan who should measure distance not in terms of the length of the straight line to their destination, but in terms of therectilinear distance, which takes into account that streets are either orthogonal or parallel to each other. The class of-norms generalizes these two examples and has an abundance of applications in many parts ofmathematics,physics, andcomputer science.
For areal number the-norm or-norm of is defined byThe absolute value bars can be dropped when is a rational number with an even numerator in its reduced form, and is drawn from the set of real numbers, or one of its subsets.
The Euclidean norm from above falls into this class and is the-norm, and the-norm is the norm that corresponds to therectilinear distance.
The-norm ormaximum norm (or uniform norm) is the limit of the-norms for, given by:
For all the-norms and maximum norm satisfy the properties of a "length function" (ornorm), that is:
only the zero vector has zero length,
the length of the vector is positive homogeneous with respect to multiplication by a scalar (positive homogeneity), and
the length of the sum of two vectors is no larger than the sum of lengths of the vectors (triangle inequality).
Abstractly speaking, this means that together with the-norm is anormed vector space. Moreover, it turns out that this space iscomplete, thus making it aBanach space.
The grid distance or rectilinear distance (sometimes called the "Manhattan distance") between two points is never shorter than the length of the line segment between them (the Euclidean or "as the crow flies" distance). Formally, this means that the Euclidean norm of any vector is bounded by its 1-norm:
This fact generalizes to-norms in that the-norm of any given vector does not grow with:
for any vector and real numbers and (In fact this remains true for and .)
For the opposite direction, the following relation between the-norm and the-norm is known:
This inequality depends on the dimension of the underlying vector space and follows directly from theCauchy–Schwarz inequality.
In for the formuladefines an absolutelyhomogeneous function for however, the resulting function does not define a norm, because it is notsubadditive. On the other hand, the formuladefines a subadditive function at the cost of losing absolute homogeneity. It does define anF-norm, though, which is homogeneous of degree
Although the-unit ball around the origin in this metric is "concave", the topology defined on by the metric is the usual vector space topology of hence is alocally convex topological vector space. Beyond this qualitative statement, a quantitative way to measure the lack of convexity of is to denote by the smallest constant such that the scalar multiple of the-unit ball contains the convex hull of which is equal to The fact that for fixed we haveshows that the infinite-dimensional sequence space defined below, is no longer locally convex.[citation needed]
There is one norm and another function called the "norm" (with quotation marks).
The mathematical definition of the norm was established byBanach'sTheory of Linear Operations. Thespace of sequences has a complete metric topology provided by theF-norm on theproduct metric:[citation needed] The-normed space is studied in functional analysis, probability theory, and harmonic analysis.
Another function was called the "norm" byDavid Donoho—whose quotation marks warn that this function is not a proper norm—is the number of non-zero entries of the vector[citation needed] Many authorsabuse terminology by omitting the quotation marks. Defining the zero "norm" of is equal to
An animated gif of p-norms 0.1 through 2 with a step of 0.05.
The space of sequences has a natural vector space structure by applying scalar addition and multiplication. Explicitly, the vector sum and the scalar action for infinitesequences of real (orcomplex) numbers are given by:
Define the-norm:
Here, a complication arises, namely that theseries on the right is not always convergent, so for example, the sequence made up of only ones, will have an infinite-norm for The space is then defined as the set of all infinite sequences of real (or complex) numbers such that the-norm is finite.
One can check that as increases, the set grows larger. For example, the sequenceis not in but it is in for as the seriesdiverges for (theharmonic series), but is convergent for
One also defines the-norm using thesupremum:and the corresponding space of all bounded sequences. It turns out that[1]if the right-hand side is finite, or the left-hand side is infinite. Thus, we will consider spaces for
The-norm thus defined on is indeed a norm, and together with this norm is aBanach space.
In complete analogy to the preceding definition one can define the space over a generalindex set (and) aswhere convergence on the right requires that only countably many summands are nonzero (see alsoAbsolute convergence over sets).With the normthe space becomes a Banach space.In the case where is finite with elements, this construction yields with the-norm defined above.If is countably infinite, this is exactly the sequence space defined above.For uncountable sets this is a non-separable Banach space which can be seen as thelocally convexdirect limit of-sequence spaces.[2]
For the-norm is even induced by a canonicalinner product called theEuclidean inner product, which means that holds for all vectors This inner product can be expressed in terms of the norm by using thepolarization identity. On it can be defined byNow consider the case Define[note 1]where for all[3][note 2]
The index set can be turned into ameasure space by giving it thediscrete σ-algebra and thecounting measure. Then the space is just a special case of the more general-space (defined below).
An space may be defined as a space of measurable functions for which the-th power of theabsolute value isLebesgue integrable, where functions which agree almost everywhere are identified. More generally, let be ameasure space and[note 3] When, consider the set of allmeasurable functions from to or whoseabsolute value raised to the-th power has a finite integral, or in symbols:[4]
To define the set for recall that two functions and defined on are said to beequalalmost everywhere, written a.e., if the set is measurable and has measure zero. Similarly, a measurable function (and itsabsolute value) isbounded (ordominated)almost everywhere by a real number written a.e., if the (necessarily) measurable set has measure zero. The space is the set of all measurable functions that are bounded almost everywhere (by some real) and is defined as theinfimum of these bounds: When then this is the same as theessential supremum of the absolute value of:[note 4]
For example, if is a measurable function that is equal to almost everywhere[note 5] then for every and thus for all
For every positive the value under of a measurable function and its absolute value are always the same (that is, for all) and so a measurable function belongs to if and only if its absolute value does. Because of this, many formulas involving-norms are stated only for non-negative real-valued functions. Consider for example the identity which holds whenever is measurable, is real, and (here when). The non-negativity requirement can be removed by substituting in for which gives Note in particular that when is finite then the formula relates the-norm to the-norm.
Seminormed space of-th power integrable functions
Each set of functions forms avector space when addition and scalar multiplication are defined pointwise.[note 6] That the sum of two-th power integrable functions and is again-th power integrable follows from[proof 1] although it is also a consequence ofMinkowski's inequality which establishes that satisfies thetriangle inequality for (the triangle inequality does not hold for). That is closed under scalar multiplication is due to beingabsolutely homogeneous, which means that for every scalar and every function
Absolute homogeneity, thetriangle inequality, and non-negativity are the defining properties of aseminorm. Thus is a seminorm and the set of-th power integrable functions together with the function defines aseminormed vector space. In general, theseminorm is not anorm because there might exist measurable functions that satisfy but are notidentically equal to[note 5] ( is a norm if and only if no such exists).
Zero sets of-seminorms
If is measurable and equals a.e. then for all positiveOn the other hand, if is a measurable function for which there exists some such that then almost everywhere. When is finite then this follows from the case and the formula mentioned above.
Thus if is positive and is any measurable function, then if and only ifalmost everywhere. Since the right hand side ( a.e.) does not mention it follows that all have the samezero set (it does not depend on). So denote this common set byThis set is a vector subspace of for every positive
Quotient vector space
Like everyseminorm, the seminorm induces anorm (defined shortly) on the canonicalquotient vector space of by its vector subspaceThis normed quotient space is calledLebesgue space and it is the subject of this article. We begin by defining the quotient vector space.
Given any thecoset consists of all measurable functions that are equal toalmost everywhere. The set of all cosets, typically denoted byforms a vector space with origin when vector addition and scalar multiplication are defined by and This particular quotient vector space will be denoted byTwo cosets are equal if and only if (or equivalently,), which happens if and only if almost everywhere; if this is the case then and are identified in the quotient space. Hence, strictly speaking consists ofequivalence classes of functions.[5]
The-norm on the quotient vector space
Given any the value of the seminorm on thecoset is constant and equal to denote this unique value by so that: This assignment defines a map, which will also be denoted by on thequotient vector spaceThis map is anorm on called the-norm. The value of a coset is independent of the particular function that was chosen to represent the coset, meaning that if is any coset then for every (since for every).
The Lebesgue space
Thenormed vector space is called space or theLebesgue space of-th power integrable functions and it is aBanach space for every (meaning that it is acomplete metric space, a result that is sometimes called theRiesz–Fischer theorem). When the underlying measure space is understood then is often abbreviated or even just Depending on the author, the subscript notation might denote either or
If the seminorm on happens to be a norm (which happens if and only if) then the normed space will belinearlyisometrically isomorphic to the normed quotient space via the canonical map (since); in other words, they will be,up to alinear isometry, the same normed space and so they may both be called " space".
In general, this process cannot be reversed: there is no consistent way to define a "canonical" representative of each coset of in For however, there is atheory of lifts enabling such recovery.
For the spaces are a special case of spaces; when are thenatural numbers and is thecounting measure. More generally, if one considers any set with the counting measure, the resulting space is denoted For example, is the space of all sequences indexed by the integers, and when defining the-norm on such a space, one sums over all the integers. The space where is the set with elements, is with its-norm as defined above.
Similar to spaces, is the onlyHilbert space among spaces. In the complex case, the inner product on is defined byFunctions in are sometimes calledsquare-integrable functions,quadratically integrable functions orsquare-summable functions, but sometimes these terms are reserved for functions that are square-integrable in some other sense, such as in the sense of aRiemann integral (Titchmarsh 1976).
As any Hilbert space, every space is linearly isometric to a suitable where the cardinality of the set is the cardinality of an arbitrary basis for this particular
If we use complex-valued functions, the space is acommutativeC*-algebra with pointwise multiplication and conjugation. For many measure spaces, including all sigma-finite ones, it is in fact a commutativevon Neumann algebra. An element of defines abounded operator on any space bymultiplication.
If then can be defined as above, that is:In this case, however, the-norm does not satisfy the triangle inequality and defines only aquasi-norm. The inequality valid for implies thatand so the functionis a metric on The resulting metric space iscomplete.[6]
In this setting satisfies areverse Minkowski inequality, that is for
The space for is anF-space: it admits a complete translation-invariant metric with respect to which the vector space operations are continuous. It is the prototypical example of anF-space that, for most reasonable measure spaces, is notlocally convex: in or every open convex set containing the function is unbounded for the-quasi-norm; therefore, the vector does not possess a fundamental system of convex neighborhoods. Specifically, this is true if the measure space contains an infinite family of disjoint measurable sets of finite positive measure.
The only nonempty convex open set in is the entire space. Consequently, there are no nonzero continuous linear functionals on thecontinuous dual space is the zero space. In the case of thecounting measure on the natural numbers (i.e.), the bounded linear functionals on are exactly those that are bounded on, i.e., those given by sequences in Although does contain non-trivial convex open sets, it fails to have enough of them to give a base for the topology.
Having no linear functionals is highly undesirable for the purposes of doing analysis. In case of the Lebesgue measure on rather than work with for it is common to work with theHardy spaceHp whenever possible, as this has quite a few linear functionals: enough to distinguish points from one another. However, theHahn–Banach theorem still fails inHp for (Duren 1970, §7.5).
This inequality, calledHölder's inequality, is in some sense optimal since if and is a measurable function such that where thesupremum is taken over the closed unit ball of then and
Minkowski inequality, which states that satisfies thetriangle inequality, can be generalized: If the measurable function is non-negative (where and are measure spaces) then for all[8]
If then every non-negative has anatomic decomposition,[9] meaning that there exist a sequence of non-negative real numbers and a sequence of non-negative functions calledthe atoms, whose supports arepairwise disjoint sets of measure such thatand for every integer andand where moreover, the sequence of functions depends only on (it is independent of).[9] These inequalities guarantee that for all integers while the supports of being pairwise disjoint implies[9]
An atomic decomposition can be explicitly given by first defining for every integer[9][note 7]and then lettingwhere denotes the measure of the set and denotes theindicator function of the set The sequence is decreasing and converges to as[9] Consequently, if then and so that is identically equal to (in particular, the division by causes no issues).
Thecomplementary cumulative distribution function of that was used to define the also appears in the definition of the weak-norm (given below) and can be used to express the-norm (for) of as the integral[9]where the integration is with respect to the usual Lebesgue measure on
For the space isreflexive. Let be as above and let be the corresponding linear isometry. Consider the map from to obtained by composing with thetranspose (or adjoint) of the inverse of
This map coincides with thecanonical embedding of into its bidual. Moreover, the map is onto, as composition of two onto isometries, and this proves reflexivity.
If the measure on issigma-finite, then the dual of is isometrically isomorphic to (more precisely, the map corresponding to is an isometry from onto
The dual of is subtler. Elements of can be identified with bounded signedfinitely additive measures on that areabsolutely continuous with respect to Seeba space for more details. If we assume the axiom of choice, this space is much bigger than except in some trivial cases. However,Saharon Shelah proved that there are relatively consistent extensions ofZermelo–Fraenkel set theory (ZF +DC + "Every subset of the real numbers has theBaire property") in which the dual of is[11]
Colloquially, if then contains functions that are more locally singular, while elements of can be more spread out. Consider theLebesgue measure on the half line A continuous function in might blow up near but must decay sufficiently fast toward infinity. On the other hand, continuous functions in need not decay at all but no blow-up is allowed. More formally:[12]
If: if and only if does not contain sets of finite but arbitrarily large measure (e.g. anyfinite measure).
If: if and only if does not contain sets of non-zero but arbitrarily small measure (e.g. thecounting measure).
Neither condition holds for the Lebesgue measure on the real line while both conditions holds for thecounting measure on any finite set. As a consequence of theclosed graph theorem, the embedding is continuous, i.e., theidentity operator is a bounded linear map from to in the first case and to in the second. Indeed, if the domain has finite measure, one can make the following explicit calculation usingHölder's inequalityleading to
The constant appearing in the above inequality is optimal, in the sense that theoperator norm of the identity is preciselythe case of equality being achieved exactly when-almost-everywhere.
Let and be a measure space and consider an integrablesimple function on given bywhere are scalars, has finite measure and is theindicator function of the set for By construction of theintegral, the vector space of integrable simple functions isdense in
Suppose is an open set with Then for every Borel set contained in there exist a closed set and an open set such thatfor every. Subsequently, there exists aUrysohn function on that is on and on with
If can be covered by an increasing sequence of open sets that have finite measure, then the space of–integrable continuous functions is dense in More precisely, one can use bounded continuous functions that vanish outside one of the open sets
This applies in particular when and when is the Lebesgue measure. For example, the space of continuous and compactly supported functions as well as the space of integrablestep functions are dense in.
If is any positive real number, is aprobability measure on a measurable space (so that), and is a vector subspace, then is a closed subspace of if and only if is finite-dimensional[13] ( was chosen independent of). In this theorem, which is due toAlexander Grothendieck,[13] it is crucial that the vector space be a subset of since it is possible to construct an infinite-dimensional closed vector subspace of (which is even a subset of), where isLebesgue measure on theunit circle and is the probability measure that results from dividing it by its mass[13]
Inpenalized regression, "L1 penalty" and "L2 penalty" refer to penalizing either the norm of a solution's vector of parameter values (i.e. the sum of its absolute values), or its squared norm (itsEuclidean length). Techniques which use an L1 penalty, likeLASSO, encourage sparse solutions (where the many parameters are zero).[14]Elastic net regularization uses a penalty term that is a combination of the norm and the squared norm of the parameter vector.
Hilbert spaces are central to many applications, fromquantum mechanics tostochastic calculus. The spaces and are both Hilbert spaces. In fact, by choosing a Hilbert basis i.e., a maximal orthonormal subset of or any Hilbert space, one sees that every Hilbert space is isometrically isomorphic to (same as above), i.e., a Hilbert space of type
A function is said to be in the spaceweak, or if there is a constant such that, for all
The best constant for this inequality is the-norm of and is denoted by
The weak coincide with theLorentz spaces so this notation is also used to denote them.
The-norm is not a true norm, since thetriangle inequality fails to hold. Nevertheless, for inand in particular
In fact, one hasand raising to power and taking the supremum in one has
Under the convention that two functions are equal if they are equal almost everywhere, then the spaces are complete (Grafakos 2004).
For any the expressionis comparable to the-norm. Further in the case this expression defines a norm if Hence for the weak spaces areBanach spaces (Grafakos 2004).
As-spaces, the weighted spaces have nothing special, since is equal to But they are the natural framework for several results in harmonic analysis (Grafakos 2004); they appear for example in theMuckenhoupt theorem: for the classicalHilbert transform is defined on where denotes theunit circle and the Lebesgue measure; the (nonlinear)Hardy–Littlewood maximal operator is bounded on Muckenhoupt's theorem describes weights such that the Hilbert transform remains bounded on and the maximal operator on
Given a measure space and alocally convex space (here assumed to becomplete), it is possible to define spaces of-integrable-valued functions on in a number of ways. One way is to define the spaces ofBochner integrable andPettis integrable functions, and then endow them withlocally convexTVS-topologies that are (each in their own way) a natural generalization of the usual topology. Another way involvestopological tensor products of with Element of the vector space are finite sums of simple tensors where each simple tensor may be identified with the function that sends Thistensor product is then endowed with a locally convex topology that turns it into atopological tensor product, the most common of which are theprojective tensor product, denoted by and theinjective tensor product, denoted by In general, neither of these space are complete so theircompletions are constructed, which are respectively denoted by and (this is analogous to how the space of scalar-valuedsimple functions on when seminormed by any is not complete so a completion is constructed which, after being quotiented by is isometrically isomorphic to the Banach space).Alexander Grothendieck showed that when is anuclear space (a concept he introduced), then these two constructions are, respectively, canonically TVS-isomorphic with the spaces of Bochner and Pettis integral functions mentioned earlier; in short, they are indistinguishable.
The topology can be defined by any metric of the formwhere is bounded continuous concave and non-decreasing on with and when (for example, Such a metric is calledLévy-metric for Under this metric the space is complete. However, as mentioned above, scalar multiplication is continuous with respect to this metric only if. To see this, consider the Lebesgue measurable function defined by. Then clearly. The space is in general not locally bounded, and not locally convex.
For the infinite Lebesgue measure on the definition of the fundamental system of neighborhoods could be modified as follows
The resulting space, with the topology of local convergence in measure, is isomorphic to the space for any positive–integrable density
^Maddox, I. J. (1988),Elements of Functional Analysis (2nd ed.), Cambridge: CUP, page 16
^Rafael Dahmen, Gábor Lukács:Long colimits of topological groups I: Continuous maps and homeomorphisms. in:Topology and its Applications Nr. 270, 2020. Example 2.14
^Garling, D. J. H. (2007).Inequalities: A Journey into Linear Analysis. Cambridge University Press. p. 54.ISBN978-0-521-87624-7.
^The definitions of and can be extended to all (rather than just), but it is only when that is guaranteed to be a norm (although is aquasi-seminorm for all).
^abFor example, if a non-empty measurable set of measure exists then itsindicator function satisfies although
^Explicitly, the vector space operations are defined by:for all and all scalars These operations make into a vector space because if is any scalar and then both and also belong to
^When the inequality can be deduced from the fact that the function defined by isconvex, which by definition means that for all and all in the domain of Substituting and in for and gives which proves that The triangle inequality now implies The desired inequality follows by integrating both sides.