| Differential equations | |||||
|---|---|---|---|---|---|
| Scope | |||||
| Classification | |||||
Types
| |||||
Relation to processes | |||||
| Solution | |||||
Solution methods | |||||
| People | |||||
Astochastic differential equation (SDE) is adifferential equation in which one or more of the terms is astochastic process,[1] resulting in a solution which is also a stochastic process. SDEs have many applications throughout pure mathematics and are used tomodel various behaviours of stochastic models such asstock prices,[2]random growth models[3] or physical systems that are subjected tothermal fluctuations.
SDEs have a random differential that is in the most basic case randomwhite noise calculated as the distributional derivative of aBrownian motion or more generally asemimartingale. However, other types of random behaviour are possible, such asjump processes likeLévy processes[4] or semimartingales with jumps.
Stochastic differential equations are in general neither differential equations norrandom differential equations. Random differential equations are conjugate to stochastic differential equations. Stochastic differential equations can also be extended todifferential manifolds.[5][6][7][8]
Stochastic differential equations originated in the theory ofBrownian motion, in the work ofAlbert Einstein andMarian Smoluchowski in 1905, althoughLouis Bachelier was the first person credited with modeling Brownian motion in 1900, giving a very early example of a stochastic differential equation now known asBachelier model. Some of these early examples were linear stochastic differential equations, also calledLangevin equations after French physicistLangevin, describing the motion of a harmonic oscillator subject to a random force. The mathematical theory of stochastic differential equations was developed in the 1940s through the groundbreaking work of Japanese mathematicianKiyosi Itô, who introduced the concept ofstochastic integral and initiated the study of nonlinear stochastic differential equations. Another approach was later proposed by Russian physicistStratonovich, leading to a calculus similar to ordinary calculus.
The most common form of SDEs in the literature is anordinary differential equation with the right hand side perturbed by a term dependent on awhite noise variable. In most cases, SDEs are understood as continuous time limit of the correspondingstochastic difference equations. This understanding of SDEs is ambiguous and must be complemented by a proper mathematical definition of the corresponding integral.[1][3] Such a mathematical definition was first proposed byKiyosi Itô in the 1940s, leading to what is known today as theItô calculus.Another construction was later proposed by Russian physicistStratonovich, leading to what is known as theStratonovich integral.TheItô integral andStratonovich integral are related, but different, objects and the choice between them depends on the application considered. TheItô calculus is based on the concept of non-anticipativeness or causality, which is natural in applications where the variable is time.The Stratonovich calculus, on the other hand, has rules which resemble ordinary calculus and has intrinsic geometric properties which render it more natural when dealing with geometric problems such as random motion onmanifolds, although it is possible and in some cases preferable to model random motion on manifolds through Itô SDEs,[6] for example when trying to optimally approximate SDEs on submanifolds.[9]
An alternative view on SDEs is the stochastic flow of diffeomorphisms. This understanding is unambiguous and corresponds to the Stratonovich version of the continuous time limit of stochastic difference equations. Associated with SDEs is theSmoluchowski equation or theFokker–Planck equation, an equation describing the time evolution ofprobability distribution functions. The generalization of the Fokker–Planck evolution to temporal evolution of differential forms is provided by the concept ofstochastic evolution operator.
In physical science, there is an ambiguity in the usage of the term"Langevin SDEs". While Langevin SDEs can be of amore general form, this term typically refers to a narrow class of SDEs with gradient flow vector fields. This class of SDEs is particularly popular because it is a starting point of the Parisi–Sourlas stochastic quantization procedure,[10] leading to a N=2 supersymmetric model closely related tosupersymmetric quantum mechanics. From the physical point of view, however, this class of SDEs is not very interesting because it never exhibits spontaneous breakdown of topological supersymmetry, i.e.,(overdamped) Langevin SDEs are never chaotic.
Brownian motion or theWiener process was discovered to be exceptionally complex mathematically. TheWiener process is almost surely nowhere differentiable;[1][3] thus, it requires its own rules of calculus. There are two dominating versions of stochastic calculus, theItô stochastic calculus and theStratonovich stochastic calculus. Each of the two has advantages and disadvantages, and newcomers are often confused whether the one is more appropriate than the other in a given situation. Guidelines exist (e.g. Øksendal, 2003)[3] and conveniently, one can readily convert an Itô SDE to an equivalent Stratonovich SDE and back again.[1][3] Still, one must be careful which calculus to use when the SDE is initially written down.
Numerical methods for solving stochastic differential equations[11] include theEuler–Maruyama method,Milstein method,Runge–Kutta method (SDE), Rosenbrock method,[12] and methods based on different representations of iterated stochastic integrals.[13][14]
In physics, SDEs have wide applicability ranging from molecular dynamics to neurodynamics and to the dynamics of astrophysical objects. More specifically, SDEs describe all dynamical systems, in which quantum effects are either unimportant or can be taken into account as perturbations. SDEs can be viewed as a generalization of thedynamical systems theory to models with noise. This is an important generalization because real systems cannot be completely isolated from their environments and for this reason always experience external stochastic influence.
There are standard techniques for transforming higher-order equations into several coupled first-order equations by introducing new unknowns. Therefore, the following is the most general class of SDEs:
where is the position in the system in itsphase (or state) space,, assumed to be a differentiable manifold, the is a flow vector field representing deterministic law of evolution, and is a set of vector fields that define the coupling of the system to Gaussian white noise,. If is a linear space and are constants, the system is said to be subject to additive noise, otherwise it is said to be subject to multiplicative noise. For additive noise, the Itô and Stratonovich forms of the SDE generate the same solution, and it is not important which definition is used to solve the SDE. For multiplicative noise SDEs the Itô and Stratonovich forms of the SDE are different, and care should be used in mapping between them.[15]
For a fixed configuration of noise, SDE has a unique solution differentiable with respect to the initial condition.[16] Nontriviality of stochastic case shows up when one tries to average various objects of interest over noise configurations. In this sense, an SDE is not a uniquely defined entity when noise is multiplicative and when the SDE is understood as a continuous time limit of astochastic difference equation. In this case, SDE must be complemented by what is known as "interpretations of SDE" such as Itô or a Stratonovich interpretations of SDEs. Nevertheless, when SDE is viewed as a continuous-time stochastic flow of diffeomorphisms, it is auniquely defined mathematical object that corresponds to Stratonovich approach to a continuous time limit of a stochastic difference equation.
In physics, the main method of solution is to find theprobability distribution function as a function of time using the equivalentFokker–Planck equation (FPE). The Fokker–Planck equation is a deterministicpartial differential equation. It tells how the probability distribution function evolves in time similarly to how theSchrödinger equation gives the time evolution of the quantum wave function or thediffusion equation gives the time evolution of chemical concentration. Alternatively, numerical solutions can be obtained byMonte Carlo simulation. Other techniques include thepath integration that draws on the analogy between statistical physics andquantum mechanics (for example, the Fokker-Planck equation can be transformed into theSchrödinger equation by rescaling a few variables) or by writing downordinary differential equations for the statisticalmoments of the probability distribution function.[citation needed]
The notation used inprobability theory (and in many applications of probability theory, for instance in signal processing with thefiltering problem and inmathematical finance) is slightly different. It is also the notation used in publications onnumerical methods for solving stochastic differential equations. This notation makes the exotic nature of the random function of time in the physics formulation more explicit. In strict mathematical terms, cannot be chosen as an ordinary function, but only as ageneralized function. The mathematical formulation treats this complication with less ambiguity than the physics formulation.
A typical equation is of the form
where denotes aWiener process (standard Brownian motion).This equation should be interpreted as an informal way of expressing the correspondingintegral equation
The equation above characterizes the behavior of thecontinuous timestochastic processXt as the sum of an ordinaryLebesgue integral and anItô integral. Aheuristic (but very helpful) interpretation of the stochastic differential equation is that in a small time interval of lengthδ the stochastic processXt changes its value by an amount that isnormally distributed withexpectationμ(Xt, t) δ andvarianceσ(Xt, t)2 δ and is independent of the past behavior of the process. This is so because the increments of a Wiener process are independent and normally distributed. The functionμ is referred to as the drift coefficient, whileσ is called the diffusion coefficient. The stochastic processXt is called adiffusion process, and satisfies theMarkov property.[1]
The formal interpretation of an SDE is given in terms of what constitutes a solution to the SDE. There are two main definitions of a solution to an SDE, a strong solution and a weak solution[1] Both require the existence of a processXt that solves the integral equation version of the SDE. The difference between the two lies in the underlyingprobability space (). A weak solution consists of a probability space and a process that satisfies the integral equation, while a strong solution is a process that satisfies the equation and is defined on a given probability space. TheYamada–Watanabe theorem makes a connection between the two.
An important example is the equation forgeometric Brownian motion
which is the equation for the dynamics of the price of astock in theBlack–Scholes options pricing model[2] of financial mathematics.
Generalizing the geometric Brownian motion, it is also possible to define SDEs admitting strong solutions and whose distribution is a convex combination of densities coming from different geometric Brownian motions or Black Scholes models, obtaining a single SDE whose solutions is distributed as a mixture dynamics of lognormal distributions of different Black Scholes models.[2][17][18][19] This leads to models that can deal with thevolatility smile in financial mathematics.
The simpler SDE calledarithmetic Brownian motion[3]
was used by Louis Bachelier as the first model for stock prices in 1900, known today asBachelier model.
There are also more general stochastic differential equations where the coefficientsμ andσ depend not only on the present value of the processXt, but also on previous values of the process and possibly on present or previous values of other processes too. In that case the solution process,X, is not a Markov process, and it is called an Itô process and not a diffusion process. When the coefficients depends only on present and past values ofX, the defining equation is called a stochastic delay differential equation.
A generalization of stochastic differential equations with the Fisk-Stratonovich integral to semimartingales with jumps are the SDEs ofMarcus type. The Marcus integral is an extension of McShane's stochastic calculus.[20]
An application instochastic finance derives from the usage of the equation forOrnstein–Uhlenbeck process
which is the equation for the dynamics of the return of the price of astock under the hypothesis that returns display aLog-normal distribution.Under this hypothesis, the methodologies developed by Marcello Minenna determines prediction interval able to identify abnormal return that could hidemarket abuse phenomena.[21][22]
More generally one can extend the theory of stochastic calculus ontodifferential manifolds and for this purpose one uses the Fisk-Stratonovich integral. Consider a manifold, some finite-dimensional vector space, a filtered probability space with satisfying theusual conditions and let be theone-point compactification and be-measurable. Astochastic differential equation on written
is a pair, such that
For each the map is linear and for each.
A solution to the SDE on with initial condition is a continuous-adapted-valued process up to life time, s.t. for each test function the process is a real-valued semimartingale and for each stopping time with the equation
holds-almost surely, where is thedifferential at. It is amaximal solution if the life time is maximal, i.e.,
-almost surely. It follows from the fact that for each test function is a semimartingale, that is asemimartingale on. Given a maximal solution we can extend the time of onto full and after a continuation of on we get
up to indistinguishable processes.[23]Although Stratonovich SDEs are the natural choice for SDEs on manifolds, given that they satisfy the chain rule and that their drift and diffusion coefficients behave as vector fields under changes of coordinates, there are cases where Ito calculus on manifolds is preferable. A theory of Ito calculus on manifolds was first developed byLaurent Schwartz through the concept of Schwartz morphism,[6] see also the related 2-jet interpretation of Ito SDEs on manifolds based on the jet-bundle.[8] This interpretation is helpful when trying to optimally approximate the solution of an SDE given on a large space with the solutions of an SDE given on a submanifold of that space,[9] in that a Stratonovich based projection does not result to be optimal. This has been applied to thefiltering problem, leading to optimal projection filters.[9]
Usually the solution of an SDE requires a probabilistic setting, as the integral implicit in the solution is a stochastic integral. If it were possible to deal with the differential equation path by path, one would not need to define a stochastic integral and one could develop a theory independently of probability theory. This points to considering the SDE
as a single deterministic differential equation for every, where is the sample space in the given probability space (). However, a direct path-wise interpretation of the SDE is not possible, as the Brownian motion paths have unbounded variation and are nowhere differentiable with probability one, so that there is no naive way to give meaning to terms like, precluding also a naive path-wise definition of the stochastic integral as an integral against every single. However, motivated by the Wong-Zakai result[24] for limits of solutions of SDEs with regular noise and usingrough paths theory, while adding a chosen definition of iterated integrals of Brownian motion, it is possible to define a deterministic rough integral for every single that coincides for example with the Ito integral with probability one for a particular choice of the iterated Brownian integral.[24] Other definitions of the iterated integral lead to deterministic pathwise equivalents of different stochastic integrals, like the Stratonovich integral. This has been used for example in financial mathematics to price options without probability.[25]
As with deterministic ordinary and partial differential equations, it is important to know whether a given SDE has a solution, and whether or not it is unique. The following is a typical existence and uniqueness theorem for Itô SDEs taking values inn-dimensionalEuclidean spaceRn and driven by anm-dimensional Brownian motionB; the proof may be found in Øksendal (2003, §5.2).[3]
LetT > 0, and let
bemeasurable functions for which there exist constantsC andD such that
for allt ∈ [0, T] and allx andy ∈ Rn, where
LetZ be a random variable that is independent of theσ-algebra generated byBs,s ≥ 0, and with finitesecond moment:
Then the stochastic differential equation/initial value problem
has a P-almost surely uniquet-continuous solution (t, ω) ↦ Xt(ω) such thatX isadapted to thefiltrationFtZ generated byZ andBs,s ≤ t, and
The stochastic differential equation above is only a special case of a more general form
where
More generally one can also look at stochastic differential equations onmanifolds.
Whether the solution of this equation explodes depends on the choice of. Suppose satisfies some local Lipschitz condition, i.e., for and some compact set and some constant the condition
where is the Euclidean norm. This condition guarantees the existence and uniqueness of a so-calledmaximal solution.
Suppose is continuous and satisfies the above local Lipschitz condition and let be some initial condition, meaning it is a measurable function with respect to the initial σ-algebra. Let be apredictable stopping time with almost surely. A-valued semimartingale is called amaximal solution of
withlife time if
is also a so-calledexplosion time.
Explicitly solvable SDEs include:[11]
where
for a given differentiable function is equivalent to the Stratonovich SDE
which has a general solution
where
for a given differentiable function is equivalent to the Stratonovich SDE
which is reducible to
where where is defined as before.Its general solution is
In supersymmetric theory of SDEs, stochastic dynamics is defined via stochastic evolution operator acting on thedifferential forms on thephase/state space of the model. In this formulation of stochastic dynamics, all SDEs possess topologicalsupersymmetry which represents the preservation of the continuity of the phase space by continuous time flow. The spontaneous breakdown of this supersymmetry is the mathematical essence of the ubiquitous dynamical phenomenon known across disciplines aschaos.