Stochastic differential equation

This article includes a list of general references, but it remains largely unverified because it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (July 2013) (Learn how and when to remove this template message)

Differential equations
Navier–Stokes differential equations used to simulate airflow around an obstruction
show Scope Natural sciences Engineering Astronomy Physics Chemistry Biology Geology Applied mathematics Continuum mechanics Chaos theory Dynamical systems Social sciences Economics Population dynamics
Classification
show Types Ordinary Partial Differential-algebraic Integro-differential Fractional Linear Non-linear By variable type Dependent and independent variables Autonomous Complex Coupled / Decoupled Exact Homogeneous / Nonhomogeneous Features Order Operator Notation
show Relation to processes Difference (discrete analogue) Stochastic Stochastic partial Delay
Solution
show Existence and uniqueness Picard–Lindelöf theorem Peano existence theorem Carathéodory's existence theorem Cauchy–Kowalevski theorem
show General topics Wronskian Phase portrait Phase space Lyapunov / Asymptotic / Exponential stability Rate of convergence Series / Integral solutions Numerical integration Dirac delta function
show Solution methods Inspection Method of characteristics Euler Exponential response formula Finite difference (Crank–Nicolson) Finite element Infinite element Finite volume Galerkin Petrov–Galerkin Integrating factor Integral transforms Perturbation theory Runge–Kutta Separation of variables Undetermined coefficients Variation of parameters
show People Isaac Newton Gottfried Leibniz Leonhard Euler Émile Picard Józef Maria Hoene-Wroński Ernst Lindelöf Rudolf Lipschitz Augustin-Louis Cauchy John Crank Phyllis Nicolson Carl David Tolmé Runge Martin Kutta
v t

A stochastic differential equation (SDE) is a differential equation in which one or more of the terms is a stochastic process, resulting in a solution which is also a stochastic process. SDEs are used to model various phenomena such as unstable stock prices or physical systems subject to thermal fluctuations. Typically, SDEs contain a variable which represents random white noise calculated as the derivative of Brownian motion or the Wiener process. However, other types of random behaviour are possible, such as jump processes. are conjugate to stochastic differential equations.^[1]

Background[]

Stochastic differential equations originated in the theory of Brownian motion, in the work of Albert Einstein and Smoluchowski. These early examples were linear stochastic differential equations, also called 'Langevin' equations after French physicist Langevin, describing the motion of a harmonic oscillator subject to a random force. The mathematical theory of stochastic differential equations was developed in the 1940s through the groundbreaking work of Japanese mathematician Kiyosi Itô, who introduced the concept of stochastic integral and initiated the study of nonlinear stochastic differential equations. Another approach was later proposed by Russian physicist Stratonovich, leading to a calculus similar to ordinary calculus.

Terminology[]

The most common form of SDEs in the literature is an ordinary differential equation with the right hand side perturbed by a term dependent on a white noise variable. In most cases, SDEs are understood as continuous time limit of the corresponding stochastic difference equations. This understanding of SDEs is ambiguous and must be complemented by a proper mathematical definition of the corresponding integral. Such a mathematical definition was first proposed by Kiyosi Itô in the 1940s, leading to what is known today as the Itô calculus. Another construction was later proposed by Russian physicist Stratonovich, leading to what is known as the Stratonovich integral. The Itô integral and Stratonovich integral are related, but different, objects and the choice between them depends on the application considered. The Itô calculus is based on the concept of non-anticipativeness or causality, which is natural in applications where the variable is time. The Stratonovich calculus, on the other hand, has rules which resemble ordinary calculus and has intrinsic geometric properties which render it more natural when dealing with geometric problems such as random motion on manifolds.

An alternative view on SDEs is the stochastic flow of diffeomorphisms. This understanding is unambiguous and corresponds to the Stratonovich version of the continuous time limit of stochastic difference equations. Associated with SDEs is the Smoluchowski equation or the Fokker–Planck equation, an equation describing the time evolution of probability distribution functions. The generalization of the Fokker–Planck evolution to temporal evolution of differential forms is provided by the concept of stochastic evolution operator.

In physical science, there is an ambiguity in the usage of the term "Langevin SDEs". While Langevin SDEs can be of a more general form, this term typically refers to a narrow class of SDEs with gradient flow vector fields. This class of SDEs is particularly popular because it is a starting point of the Parisi–Sourlas stochastic quantization procedure,^[2] leading to a N=2 supersymmetric model closely related to supersymmetric quantum mechanics. From the physical point of view, however, this class of SDEs is not very interesting because it never exhibits spontaneous breakdown of topological supersymmetry, i.e., (overdamped) Langevin SDEs are never chaotic.

Stochastic calculus[]

Brownian motion or the Wiener process was discovered to be exceptionally complex mathematically. The Wiener process is almost surely nowhere differentiable; thus, it requires its own rules of calculus. There are two dominating versions of stochastic calculus, the Itô stochastic calculus and the Stratonovich stochastic calculus. Each of the two has advantages and disadvantages, and newcomers are often confused whether the one is more appropriate than the other in a given situation. Guidelines exist (e.g. Øksendal, 2003) and conveniently, one can readily convert an Itô SDE to an equivalent Stratonovich SDE and back again. Still, one must be careful which calculus to use when the SDE is initially written down.

Numerical solutions[]

Numerical methods for solving stochastic differential equations include the Euler–Maruyama method, Milstein method and Runge–Kutta method (SDE).

Use in physics[]

In physics, SDEs have widest applicability ranging from molecular dynamics to neurodynamics and to the dynamics of astrophysical objects. More specifically, SDEs describe all dynamical systems, in which quantum effects are either unimportant or can be taken into account as perturbations. SDEs can be viewed as a generalization of the dynamical systems theory to models with noise. This is an important generalization because real systems cannot be completely isolated from their environments and for this reason always experience external stochastic influence.

There are standard techniques for transforming higher-order equations into several coupled first-order equations by introducing new unknowns. Therefore, the following is the most general class of SDEs:

${\displaystyle {\frac {dx(t)}{dt}}=F(x(t))+\sum _{\alpha =1}^{n}g_{\alpha }(x(t))\xi ^{\alpha }(t),\,}$

where ${\displaystyle x\in X}$ is the position in the system in its phase (or state) space, ${\displaystyle X}$, assumed to be a differentiable manifold, the ${\displaystyle F\in TX}$ is a flow vector field representing deterministic law of evolution, and ${\displaystyle g_{\alpha }\in TX}$ is a set of vector fields that define the coupling of the system to Gaussian white noise, ${\displaystyle \xi ^{\alpha }}$. If ${\displaystyle X}$ is a linear space and ${\displaystyle g}$ are constants, the system is said to be subject to additive noise, otherwise it is said to be subject to multiplicative noise. This term is somewhat misleading as it has come to mean the general case even though it appears to imply the limited case in which ${\displaystyle g(x)\propto x}$.

For a fixed configuration of noise, SDE has a unique solution differentiable with respect to the initial condition.^[3] Nontriviality of stochastic case shows up when one tries to average various objects of interest over noise configurations. In this sense, an SDE is not a uniquely defined entity when noise is multiplicative and when the SDE is understood as a continuous time limit of a stochastic difference equation. In this case, SDE must be complemented by what is known as "interpretations of SDE" such as Itô or a Stratonovich interpretations of SDEs. Nevertheless, when SDE is viewed as a continuous-time stochastic flow of diffeomorphisms, it is a uniquely defined mathematical object that corresponds to Stratonovich approach to a continuous time limit of a stochastic difference equation.

In physics, the main method of solution is to find the probability distribution function as a function of time using the equivalent Fokker–Planck equation (FPE). The Fokker–Planck equation is a deterministic partial differential equation. It tells how the probability distribution function evolves in time similarly to how the Schrödinger equation gives the time evolution of the quantum wave function or the diffusion equation gives the time evolution of chemical concentration. Alternatively, numerical solutions can be obtained by Monte Carlo simulation. Other techniques include the path integration that draws on the analogy between statistical physics and quantum mechanics (for example, the Fokker-Planck equation can be transformed into the Schrödinger equation by rescaling a few variables) or by writing down ordinary differential equations for the statistical moments of the probability distribution function.^{[citation needed]}

Use in probability and mathematical finance[]

The notation used in probability theory (and in many applications of probability theory, for instance mathematical finance) is slightly different. It is also the notation used in publications on numerical methods for solving stochastic differential equations. This notation makes the exotic nature of the random function of time ${\displaystyle \eta _{m}}$ in the physics formulation more explicit. In strict mathematical terms, ${\displaystyle \eta _{m}}$ cannot be chosen as an ordinary function, but only as a generalized function. The mathematical formulation treats this complication with less ambiguity than the physics formulation.

A typical equation is of the form

${\displaystyle \mathrm {d} X_{t}=\mu (X_{t},t)\,\mathrm {d} t+\sigma (X_{t},t)\,\mathrm {d} B_{t},}$

where ${\displaystyle B}$ denotes a Wiener process (Standard Brownian motion). This equation should be interpreted as an informal way of expressing the corresponding integral equation

${\displaystyle X_{t+s}-X_{t}=\int _{t}^{t+s}\mu (X_{u},u)\mathrm {d} u+\int _{t}^{t+s}\sigma (X_{u},u)\,\mathrm {d} B_{u}.}$

The equation above characterizes the behavior of the continuous time stochastic process X_t as the sum of an ordinary Lebesgue integral and an Itô integral. A heuristic (but very helpful) interpretation of the stochastic differential equation is that in a small time interval of length δ the stochastic process X_t changes its value by an amount that is normally distributed with expectation μ(X_t, t) δ and variance σ(X_t, t)² δ and is independent of the past behavior of the process. This is so because the increments of a Wiener process are independent and normally distributed. The function μ is referred to as the drift coefficient, while σ is called the diffusion coefficient. The stochastic process X_t is called a diffusion process, and satisfies the Markov property.

The formal interpretation of an SDE is given in terms of what constitutes a solution to the SDE. There are two main definitions of a solution to an SDE, a strong solution and a weak solution. Both require the existence of a process X_t that solves the integral equation version of the SDE. The difference between the two lies in the underlying probability space (${\displaystyle \Omega ,\,{\mathcal {F}},\,P}$). A weak solution consists of a probability space and a process that satisfies the integral equation, while a strong solution is a process that satisfies the equation and is defined on a given probability space.

An important example is the equation for geometric Brownian motion

${\displaystyle \mathrm {d} X_{t}=\mu X_{t}\,\mathrm {d} t+\sigma X_{t}\,\mathrm {d} B_{t}.}$

which is the equation for the dynamics of the price of a stock in the Black–Scholes options pricing model of financial mathematics.

There are also more general stochastic differential equations where the coefficients μ and σ depend not only on the present value of the process X_t, but also on previous values of the process and possibly on present or previous values of other processes too. In that case the solution process, X, is not a Markov process, and it is called an Itô process and not a diffusion process. When the coefficients depends only on present and past values of X, the defining equation is called a stochastic delay differential equation.

Existence and uniqueness of solutions[]

As with deterministic ordinary and partial differential equations, it is important to know whether a given SDE has a solution, and whether or not it is unique. The following is a typical existence and uniqueness theorem for Itô SDEs taking values in n-dimensional Euclidean space Rⁿ and driven by an m-dimensional Brownian motion B; the proof may be found in Øksendal (2003, §5.2).

Let T > 0, and let

${\displaystyle \mu :\mathbb {R} ^{n}\times [0,T]\to \mathbb {R} ^{n};}$

${\displaystyle \sigma :\mathbb {R} ^{n}\times [0,T]\to \mathbb {R} ^{n\times m};}$

be measurable functions for which there exist constants C and D such that

${\displaystyle {\big |}\mu (x,t){\big |}+{\big |}\sigma (x,t){\big |}\leq C{\big (}1+|x|{\big )};}$

${\displaystyle {\big |}\mu (x,t)-\mu (y,t){\big |}+{\big |}\sigma (x,t)-\sigma (y,t){\big |}\leq D|x-y|;}$

for all t ∈ [0, T] and all x and y ∈ Rⁿ, where

${\displaystyle |\sigma |^{2}=\sum _{i,j=1}^{n}|\sigma _{ij}|^{2}.}$

Let Z be a random variable that is independent of the σ-algebra generated by B_s, s ≥ 0, and with finite second moment:

${\displaystyle \mathbb {E} {\big [}|Z|^{2}{\big ]}<+\infty .}$

Then the stochastic differential equation/initial value problem

${\displaystyle \mathrm {d} X_{t}=\mu (X_{t},t)\,\mathrm {d} t+\sigma (X_{t},t)\,\mathrm {d} B_{t}{\mbox{ for }}t\in [0,T];}$

${\displaystyle X_{0}=Z;}$

has a P-almost surely unique t-continuous solution (t, ω) ↦ X_t(ω) such that X is adapted to the filtration F_t^Z generated by Z and B_s, s ≤ t, and

${\displaystyle \mathbb {E} \left[\int _{0}^{T}|X_{t}|^{2}\,\mathrm {d} t\right]<+\infty .}$

Some explicitly solvable SDEs^[4][]

Linear SDE: general case[]

${\displaystyle dX_{t}=(a(t)X_{t}+c(t))dt+(b(t)X_{t}+d(t))dW_{t}}$

${\displaystyle X_{t}=\Phi _{t,t_{0}}\left(X_{t_{0}}+\int _{t_{0}}^{t}\Phi _{s,t_{0}}^{-1}(c(s)-b(s)d(s))ds+\int _{t_{0}}^{t}\Phi _{s,t_{0}}^{-1}d(s)dW_{s}\right)}$

where

${\displaystyle \Phi _{t,t_{0}}=\exp \left(\int _{t_{0}}^{t}\left(a(s)-{\frac {b^{2}(s)}{2}}\right)ds+\int _{t_{0}}^{t}b(s)dW_{s}\right)}$

Reducible SDEs: Case 1[]

${\displaystyle dX_{t}={\frac {1}{2}}f(X_{t})f'(X_{t})dt+f(X_{t})dW_{t}}$

for a given differentiable function ${\displaystyle f}$ is equivalent to the Stratonovich SDE

${\displaystyle dX_{t}=f(X_{t})\circ W_{t}}$

which has a general solution

${\displaystyle X_{t}=h^{-1}(W_{t}+h(X_{0}))}$

where

${\displaystyle h(x)=\int ^{x}{\frac {ds}{f(s)}}}$

Reducible SDEs: Case 2[]

${\displaystyle dX_{t}=\left(\alpha f(X_{t})+{\frac {1}{2}}f(X_{t})f'(X_{t})\right)dt+f(X_{t})dW_{t}}$

for a given differentiable function ${\displaystyle f}$ is equivalent to the Stratonovich SDE

${\displaystyle dX_{t}=\alpha f(X_{t})dt+f(X_{t})\circ W_{t}}$

which is reducible to

${\displaystyle dY_{t}=\alpha dt+dW_{t}}$

where ${\displaystyle Y_{t}=h(X_{t})}$ where ${\displaystyle h}$ is defined as before. Its general solution is

${\displaystyle X_{t}=h^{-1}(\alpha t+W_{t}+h(X_{0}))}$

SDEs and supersymmetry[]

In supersymmetric theory of SDEs, stochastic dynamics is defined via stochastic evolution operator acting on the differential forms on the phase space of the model. In this exact formulation of stochastic dynamics, all SDEs possess topological supersymmetry which represents the preservation of the continuity of the phase space by continuous time flow. The spontaneous breakdown of this supersymmetry is the mathematical essence of the ubiquitous dynamical phenomenon known across disciplines as chaos, turbulence, self-organized criticality etc. and the Goldstone theorem explains the associated long-range dynamical behavior, i.e., the butterfly effect, 1/f and crackling noises, and scale-free statistics of earthquakes, neuroavalanches, solar flares etc. The theory also offers a resolution of the Ito–Stratonovich dilemma in favor of Stratonovich approach.

See also[]

• Langevin dynamics
• Local volatility
• Stochastic process
• Stochastic volatility
• Stochastic partial differential equations
• Diffusion process
• Stochastic difference equation

References[]

Further reading[]

• Adomian, George (1983). Stochastic systems. Mathematics in Science and Engineering (169). Orlando, FL: Academic Press Inc.
• Adomian, George (1986). Nonlinear stochastic operator equations. Orlando, FL: Academic Press Inc.
• Adomian, George (1989). Nonlinear stochastic systems theory and applications to physics. Mathematics and its Applications (46). Dordrecht: Kluwer Academic Publishers Group.
• Calin, Ovidiu (2015). An Informal Introduction to Stochastic Calculus with Applications. Singapore: World Scientific Publishing. p. 315. ISBN 978-981-4678-93-3.
• Øksendal, Bernt K. (2003). Stochastic Differential Equations: An Introduction with Applications. Berlin: Springer. ISBN 3-540-04758-1.
• Teugels, J. and Sund B. (eds.) (2004). Encyclopedia of Actuarial Science. Chichester: Wiley. pp. 523–527.CS1 maint: extra text: authors list (link)
• C. W. Gardiner (2004). Handbook of Stochastic Methods: for Physics, Chemistry and the Natural Sciences. Springer. p. 415.
• Thomas Mikosch (1998). Elementary Stochastic Calculus: with Finance in View. Singapore: World Scientific Publishing. p. 212. ISBN 981-02-3543-7.
• Seifedine Kadry (2007). "A Solution of Linear Stochastic Differential Equation". Wseas Transactions on Mathematics. USA: WSEAS TRANSACTIONS on MATHEMATICS, April 2007.: 618. ISSN 1109-2769.
• P. E. Kloeden & E. Platen (1995). Numerical Solution of Stochastic Differential Equations. Springer. ISBN 0-387-54062-8.
• Higham., Desmond J. (January 2001). "An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations". SIAM Review. 43 (3): 525–546. Bibcode:2001SIAMR..43..525H. CiteSeerX 10.1.1.137.6375. doi:10.1137/S0036144500378302.
• Desmond Higham and Peter Kloeden: "An Introduction to the Numerical Simulation of Stochastic Differential Equations", SIAM, ISBN 978-1-611976-42-7 (2021).