Incalculus, theLeibniz integral rule for differentiation under the integral sign, named afterGottfried Wilhelm Leibniz, states that for anintegral of the formwhere and the integrands arefunctions dependent on the derivative of this integral is expressible aswhere thepartial derivative indicates that inside the integral, only the variation of with is considered in taking the derivative.[1]
In the special case where the functions and are constants and with values that do not depend on this simplifies to:
If is constant and, which is another common situation (for example, in the proof ofCauchy's repeated integration formula), the Leibniz integral rule becomes:
This important result may, under certain conditions, be used to interchange the integral and partial differentialoperators, and is particularly useful in the differentiation ofintegral transforms. An example of such is themoment generating function inprobability theory, a variation of theLaplace transform, which can be differentiated to generate themoments of arandom variable. Whether Leibniz's integral rule applies is essentially a question about the interchange oflimits.
General form: differentiation under the integral sign
Theorem—Let be a function such that both and its partial derivative are continuous in and in some region of the-plane, including Also suppose that the functions and are both continuous and both have continuous derivatives for Then, for
Stronger versions of the theorem only require that the partial derivative existalmost everywhere, and not that it be continuous.[2] This formula is the general form of the Leibniz integral rule and can be derived using thefundamental theorem of calculus. The (first) fundamental theorem of calculus is just the particular case of the above formula where is constant, and does not depend on
If both upper and lower limits are taken as constants, then the formula takes the shape of anoperator equation:where is thepartial derivative with respect to and is the integral operator with respect to over a fixedinterval. That is, it is related to thesymmetry of second derivatives, but involving integrals as well as derivatives. This case is also known as the Leibniz integral rule.
The following three basic theorems on theinterchange of limits are essentially equivalent:
the interchange of a derivative and an integral (differentiation under the integral sign; i.e., Leibniz integral rule);
the change of order of partial derivatives;
the change of order of integration (integration under the integral sign; i.e.,Fubini's theorem).
The Leibniz integral rule can be extended to multidimensional integrals. In two and three dimensions, this rule is better known from the field offluid dynamics as theReynolds transport theorem:
where is a scalar function,D(t) and∂D(t) denote a time-varying connected region ofR3 and its boundary, respectively, is the Eulerian velocity of the boundary (seeLagrangian and Eulerian coordinates) anddΣ =ndS is the unit normal component of thesurfaceelement.
The above formula can be deduced directly from the fact that theLie derivative interacts nicely with integration of differential formsfor the spacetime manifold, where the spacetime exterior derivative of is and the surface has spacetime velocity field.Since has only spatial components, the Lie derivative can be simplified usingCartan's magic formula, towhich, after integrating over and usinggeneralized Stokes' theorem on the second term, reduces to the three desired terms.
We first prove the case of constant limits of integrationa andb.
We useFubini's theorem to change the order of integration. For everyx andh, such thath > 0 and bothx andx +h are within[x0,x1], we have:
Note that the integrals at hand are well defined since is continuous at the closed rectangle and thus also uniformly continuous there; thus its integrals by eitherdt ordx are continuous in the other variable and also integrable by it (essentially this is because for uniformly continuous functions, one may pass the limit through the integration sign, as elaborated below).
Therefore:
Where we have defined:(we may replacex0 here by any other point betweenx0 andx)
F is differentiable with derivative, so we can take the limit whereh approaches zero. For the left hand side this limit is:
For the right hand side, we get:And we thus prove the desired result:
Another proof using the bounded convergence theorem
Note that this proof is weaker in the sense that it only shows thatfx(x,t) is Lebesgue integrable, but not that it is Riemann integrable. In the former (stronger) proof, iff(x,t) is Riemann integrable, then so isfx(x,t) (and thus is obviously also Lebesgue integrable).
Let
1
By the definition of the derivative,
2
Substitute equation (1) into equation (2). The difference of two integrals equals the integral of the difference, and 1/h is a constant, so
We now show that the limit can be passed through the integral sign.
We claim that the passage of the limit under the integral sign is valid by the bounded convergence theorem (a corollary of thedominated convergence theorem). For eachδ > 0, consider thedifference quotientFort fixed, themean value theorem implies there existsz in the interval [x,x +δ] such thatContinuity offx(x,t) and compactness of the domain together imply thatfx(x,t) is bounded. The above application of the mean value theorem therefore gives a uniform (independent of) bound on. The difference quotients converge pointwise to the partial derivativefx by the assumption that the partial derivative exists.
The above argument shows that for every sequence {δn} → 0, the sequence is uniformly bounded and converges pointwise tofx. The bounded convergence theorem states that if a sequence of functions on a set of finite measure is uniformly bounded and converges pointwise, then passage of the limit under the integral is valid. In particular, the limit and integral may be exchanged for every sequence {δn} → 0. Therefore, the limit asδ → 0 may be passed through the integral sign.
If instead we only know that there is an integrable function such that, then and the dominated convergence theorem allows us to move the limit inside of the integral.
Note: This form can be particularly useful if the expression to be differentiated is of the form:Because does not depend on the limits of integration, it may be moved out from under the integral sign, and the above form may be used with theProduct rule, i.e.,
Setwherea andb are functions ofα that exhibit increments Δa and Δb, respectively, whenα is increased by Δα. Then,
A form of themean value theorem,, wherea <ξ <b, may be applied to the first and last integrals of the formula for Δφ above, resulting in
Divide by Δα and let Δα → 0. Noticeξ1 →a andξ2 →b. We may pass the limit through the integral sign:again by the bounded convergence theorem. This yields the general form of the Leibniz integral rule,
Alternative proof of the general form with variable limits, using the chain rule
The general form of Leibniz's Integral Rule with variable limits can be derived as a consequence of thebasic form of Leibniz's Integral Rule, themultivariable chain rule, and thefirst fundamental theorem of calculus. Suppose is defined in a rectangle in the plane, for and. Also, assume and the partial derivative are both continuous functions on this rectangle. Suppose aredifferentiable real valued functions defined on, with values in (i.e. for every). Now, setand
Since the functions are all differentiable (see the remark at the end of the proof), by themultivariable chain rule, it follows that is differentiable, and its derivative is given by the formula:Now, note that for every, and for every, we have that, because when taking the partial derivative with respect to of, we are keeping fixed in the expression; thus thebasic form of Leibniz's Integral Rule with constant limits of integration applies. Next, by thefirst fundamental theorem of calculus, we have that; because when taking the partial derivative with respect to of, the first variable is fixed, so the fundamental theorem can indeed be applied.
Substituting these results into the equation for above gives:as desired.
There is a technical point in the proof above which is worth noting: applying the Chain Rule to requires that already bedifferentiable. This is where we use our assumptions about. As mentioned above, the partial derivatives of are given by the formulas and. Since is continuous, its integral is also a continuous function,[7] and since is also continuous, these two results show that both the partial derivatives of are continuous. Since continuity of partial derivatives implies differentiability of the function,[8] is indeed differentiable.
At timet the surface Σ inFigure 1 contains a set of points arranged about a centroid. The function can be written aswith independent of time. Variables are shifted to a new frame of reference attached to the moving surface, with origin at. For a rigidly translating surface, the limits of integration are then independent of time, so:where the limits of integration confining the integral to the region Σ no longer are time dependent so differentiation passes through the integration to act on the integrand only:with the velocity of motion of the surface defined by
This equation expresses thematerial derivative of the field, that is, the derivative with respect to a coordinate system attached to the moving surface. Having found the derivative, variables can be switched back to the original frame of reference. We notice that (seearticle on curl)and thatStokes theorem equates the surface integral of the curl over Σ with a line integral over∂Σ:
The sign of the line integral is based on theright-hand rule for the choice of direction of line elementds. To establish this sign, for example, suppose the fieldF points in the positivez-direction, and the surface Σ is a portion of thexy-plane with perimeter ∂Σ. We adopt the normal to Σ to be in the positivez-direction. Positive traversal of ∂Σ is then counterclockwise (right-hand rule with thumb alongz-axis). Then the integral on the left-hand side determines apositive flux ofF through Σ. Suppose Σ translates in the positivex-direction at velocityv. An element of the boundary of Σ parallel to they-axis, sayds, sweeps out an areavt ×ds in timet. If we integrate around the boundary ∂Σ in a counterclockwise sense,vt ×ds points in the negativez-direction on the left side of ∂Σ (whereds points downward), and in the positivez-direction on the right side of ∂Σ (whereds points upward), which makes sense because Σ is moving to the right, adding area on the right and losing it on the left. On that basis, the flux ofF is increasing on the right of ∂Σ and decreasing on the left. However, thedot productv ×F ⋅ds = −F ×v ⋅ds = −F ⋅v ×ds. Consequently, the sign of the line integral is taken as negative.
Ifv is a constant,which is the quoted result. This proof does not consider the possibility of the surface deforming as it moves.
Supposea andb are constant, and thatf(x) involves a parameterα which is constant in the integration but may vary to form different integrals. Assume thatf(x,α) is a continuous function ofx andα in the compact set {(x,α) :α0 ≤α ≤α1 anda ≤x ≤b}, and that the partial derivativefα(x,α) exists and is continuous. If one defines:then may be differentiated with respect toα by differentiating under the integral sign, i.e.,
By theHeine–Cantor theorem it is uniformly continuous in that set. In other words, for anyε > 0 there exists Δα such that for all values ofx in [a,b],
On the other hand,
Henceφ(α) is a continuous function.
Similarly if exists and is continuous, then for allε > 0 there exists Δα such that:
Therefore,where
Now,ε → 0 as Δα → 0, so
This is the formula we set out to prove.
Now, supposewherea andb are functions ofα which take increments Δa and Δb, respectively, whenα is increased by Δα. Then,
A form of themean value theorem, wherea <ξ <b, can be applied to the first and last integrals of the formula for Δφ above, resulting in
Dividing by Δα, letting Δα → 0, noticingξ1 →a andξ2 →b and using the above derivation foryields
This is the general form of the Leibniz integral rule.
The formulacan be of use when evaluating certain definite integrals. When used in this context, the Leibniz integral rule for differentiating under the integral sign is also known as Feynman's trick/technique for integration.
To determine in the same manner, we should need to substitute in a value of greater than 1 in. This is somewhat inconvenient. Instead, we substitute, where. Then,
Therefore,
The definition of is now complete:
The foregoing discussion, of course, does not apply when, since the conditions for differentiability are not met.
The limits of integration being independent of, we have:
On the other hand:
Equating these two relations then yields
In a similar fashion, pursuing yields
Adding the two results then produceswhich computes as desired.
This derivation may be generalized. Note that if we defineit can easily be shown that
Given, this integral reduction formula can be used to compute all of the values of for. Integrals like and may also be handled using theWeierstrass substitution.
We introduce a new variableφ and rewrite the integral as
Whenφ = 1 this equals the original integral. However, this more general integral may be differentiated with respect to:
Now, fixφ, and consider the vector field on defined by. Further, choose thepositive oriented parameterization of theunit circle given by,, so that. Then the final integral above is preciselythe line integral of over. ByGreen's Theorem, this equals the double integralwhere is the closedunit disc. Its integrand is identically 0, so is likewise identically zero. This implies thatf(φ) is constant. The constant may be determined by evaluating at:
There are innumerable other integrals that can be solved using the technique of differentiation under the integral sign. For example, in each of the following cases, the original integral may be replaced by a similar integral having a new parameter:
The first integral, theDirichlet integral, is absolutely convergent for positiveα but only conditionally convergent when. Therefore, differentiation under the integral sign is easy to justify when, but proving that the resulting formula remains valid when requires some careful work.
The measure-theoretic version of differentiation under the integral sign also applies to summation (finite or infinite) by interpreting summation ascounting measure. An example of an application is the fact thatpower series are differentiable in their radius of convergence.[citation needed]
Differentiation under the integral sign is mentioned in the latephysicistRichard Feynman's best-selling memoirSurely You're Joking, Mr. Feynman! in the chapter "A Different Box of Tools". He describes learning it, while inhigh school, from an old text,Advanced Calculus (1926), byFrederick S. Woods (who was a professor of mathematics in theMassachusetts Institute of Technology). The technique was not often taught when Feynman later received his formal education incalculus, but using this technique, Feynman was able to solve otherwise difficult integration problems upon his arrival at graduate school atPrinceton University:
One thing I never did learn wascontour integration. I had learned to do integrals by various methods shown in a book that my high school physics teacher Mr. Bader had given me. One day he told me to stay after class. "Feynman," he said, "you talk too much and you make too much noise. I know why. You're bored. So I'm going to give you a book. You go up there in the back, in the corner, and study this book, and when you know everything that's in this book, you can talk again." So every physics class, I paid no attention to what was going on with Pascal's Law, or whatever they were doing. I was up in the back with this book:"Advanced Calculus", by Woods. Bader knew I had studied"Calculus for the Practical Man" a little bit, so he gave me the real works—it was for a junior or senior course in college. It hadFourier series,Bessel functions,determinants,elliptic functions—all kinds of wonderful stuff that I didn't know anything about. That book also showed how to differentiate parameters under the integral sign—it's a certain operation. It turns out that's not taught very much in the universities; they don't emphasize it. But I caught on how to use that method, and I used that one damn tool again and again. So because I was self-taught using that book, I had peculiar methods of doing integrals. The result was, when guys at MIT orPrinceton had trouble doing a certain integral, it was because they couldn't do it with the standard methods they had learned in school. If it was contour integration, they would have found it; if it was a simple series expansion, they would have found it. Then I come along and try differentiating under the integral sign, and often it worked. So I got a great reputation for doing integrals, only because my box of tools was different from everybody else's, and they had tried all their tools on it before giving the problem to me.