Galerkin method

Differential equations
Navier–Stokes differential equations used to simulate airflow around an obstruction
show Scope Natural sciences Engineering Astronomy Physics Chemistry Biology Geology Applied mathematics Continuum mechanics Chaos theory Dynamical systems Social sciences Economics Population dynamics
Classification
show Types Ordinary Partial Differential-algebraic Integro-differential Fractional Linear Non-linear By variable type Dependent and independent variables Autonomous Complex Coupled / Decoupled Exact Homogeneous / Nonhomogeneous Features Order Operator Notation
show Relation to processes Difference (discrete analogue) Stochastic Stochastic partial Delay
Solution
show Existence and uniqueness Picard–Lindelöf theorem Peano existence theorem Carathéodory's existence theorem Cauchy–Kowalevski theorem
show General topics Wronskian Phase portrait Phase space Lyapunov / Asymptotic / Exponential stability Rate of convergence Series / Integral solutions Numerical integration Dirac delta function
show Solution methods Inspection Method of characteristics Euler Exponential response formula Finite difference (Crank–Nicolson) Finite element Infinite element Finite volume Galerkin Petrov–Galerkin Integrating factor Integral transforms Perturbation theory Runge–Kutta Separation of variables Undetermined coefficients Variation of parameters
show People Isaac Newton Gottfried Leibniz Leonhard Euler Émile Picard Józef Maria Hoene-Wroński Ernst Lindelöf Rudolf Lipschitz Augustin-Louis Cauchy John Crank Phyllis Nicolson Carl David Tolmé Runge Martin Kutta
v t

In mathematics, in the area of numerical analysis, Galerkin methods, named after the Russian mathematician Boris Galerkin, convert a continuous operator problem, such as a differential equation, commonly in a weak formulation, to a discrete problem by applying linear constraints determined by finite sets of basis functions.

Often when referring to a Galerkin method, one also gives the name along with typical assumptions and approximation methods used:

• Ritz–Galerkin method (after Walther Ritz) typically assumes symmetric and positive definite bilinear form in the weak formulation, where the differential equation for a physical system can be formulated via minimization of a quadratic function representing the system energy and the approximate solution is a linear combination of the given set of the basis functions.^[1]
• Bubnov–Galerkin method (after Ivan Bubnov) does not require the bilinear form to be symmetric and substitutes the energy minimization with orthogonality constrains determined by the same basis functions that are used to approximate the solution. In an operator formulation of the differential equation, Bubnov–Galerkin method can be viewed as applying an orthogonal projection to the operator.
• Petrov–Galerkin method (after Georgii I. Petrov^[2]) allows using basis functions for orthogonality constrains (called test basis functions) that are different from the basis functions used to approximate the solution. Petrov–Galerkin method can be viewed as an extension of Bubnov–Galerkin method, applying an projection that is not necessarily orthogonal in the operator formulation of the differential equation.

Examples of Galerkin methods are:

• the Galerkin method of weighted residuals, the most common method of calculating the global stiffness matrix in the finite element method,^[3][4]
• the boundary element method for solving integral equations,
• Krylov subspace methods.^[5]

Example: matrix linear system[]

We first introduce and illustrate the Galerkin method as being applied to a system of linear equations ${\displaystyle A\mathbf {x} =\mathbf {b} }$ with the following symmetric and positive definite matrix

${\displaystyle A={\begin{bmatrix}2&0&0\\0&2&1\\0&1&2\end{bmatrix}}}$

and the solution and right-hand-side vectors

${\displaystyle \mathbf {x} ={\begin{bmatrix}1\\0\\0\end{bmatrix}},\quad \mathbf {b} ={\begin{bmatrix}2\\0\\0\end{bmatrix}}.}$

Let us take

${\displaystyle V={\begin{bmatrix}0&0\\1&0\\0&1\end{bmatrix}},}$

then the matrix of the Galerkin equation is

${\displaystyle V^{*}AV={\begin{bmatrix}2&1\\1&2\end{bmatrix}},}$

the right-hand-side vector of the Galerkin equation is

${\displaystyle V^{*}\mathbf {b} ={\begin{bmatrix}0\\0\end{bmatrix}},}$

so that we obtain the solution vector

${\displaystyle \mathbf {y} ={\begin{bmatrix}0\\0\end{bmatrix}}}$

to the Galerkin equation ${\displaystyle \left(V^{*}AV\right)\mathbf {y} =V^{*}\mathbf {b} }$, which we finally uplift to determine the approximate solution to the original equation as

${\displaystyle V\mathbf {y} ={\begin{bmatrix}0\\0\\0\end{bmatrix}}.}$

In this example, our original Hilbert space is actually the 3-dimensional Euclidian space ${\displaystyle \mathbb {R} ^{3}}$ equipped with the standard scalar product ${\displaystyle (\mathbf {u} ,\mathbf {v} )=\mathbf {u} ^{T}\mathbf {v} }$, our 3-by-3 matrix ${\displaystyle A}$ defines the bilinear form ${\displaystyle a(\mathbf {u} ,\mathbf {v} )=\mathbf {u} ^{T}A\mathbf {v} }$, and the right-hand-side vector ${\displaystyle \mathbf {b} }$ defines the bounded linear functional ${\displaystyle f(\mathbf {v} )=\mathbf {b} ^{T}\mathbf {v} }$. The columns

${\displaystyle \mathbf {e} _{1}={\begin{bmatrix}0\\1\\0\end{bmatrix}}\quad \mathbf {e} _{2}={\begin{bmatrix}0\\0\\1\end{bmatrix}},}$

of the matrix ${\displaystyle V}$ form an orthonormal basis of the 2-dimensional subspace of the Galerkin projection. The entries of the 2-by-2 Galerkin matrix ${\displaystyle V^{*}AV}$ are ${\displaystyle a(e_{j},e_{i}),\,i,j=1,2}$, while the components of the right-hand-side vector ${\displaystyle V^{*}\mathbf {b} }$ of the Galerkin equation are ${\displaystyle f(e_{i}),\,i=1,2}$. Finally, the approximate solution ${\displaystyle V\mathbf {y} }$ is obtained from the components of the solution vector ${\displaystyle \mathbf {y} }$ of the Galerkin equation and the basis as ${\displaystyle \sum _{j=1}^{2}\mathbf {y} _{j}\mathbf {e} _{j}}$.

Linear equation in a Hilbert space[]

Weak formulation of a linear equation[]

Let us introduce Galerkin's method with an abstract problem posed as a weak formulation on a Hilbert space ${\displaystyle V}$, namely,

find ${\displaystyle u\in V}$ such that for all ${\displaystyle v\in V,a(u,v)=f(v)}$.

Here, ${\displaystyle a(\cdot ,\cdot )}$ is a bilinear form (the exact requirements on ${\displaystyle a(\cdot ,\cdot )}$ will be specified later) and ${\displaystyle f}$ is a bounded linear functional on ${\displaystyle V}$.

Galerkin dimension reduction[]

Choose a subspace ${\displaystyle V_{n}\subset V}$ of dimension n and solve the projected problem:

Find ${\displaystyle u_{n}\in V_{n}}$ such that for all ${\displaystyle v_{n}\in V_{n},a(u_{n},v_{n})=f(v_{n})}$.

We call this the Galerkin equation. Notice that the equation has remained unchanged and only the spaces have changed. Reducing the problem to a finite-dimensional vector subspace allows us to numerically compute ${\displaystyle u_{n}}$ as a finite linear combination of the basis vectors in ${\displaystyle V_{n}}$.

Galerkin orthogonality[]

The key property of the Galerkin approach is that the error is orthogonal to the chosen subspaces. Since ${\displaystyle V_{n}\subset V}$, we can use ${\displaystyle v_{n}}$ as a test vector in the original equation. Subtracting the two, we get the Galerkin orthogonality relation for the error, ${\displaystyle \epsilon _{n}=u-u_{n}}$ which is the error between the solution of the original problem, ${\displaystyle u}$, and the solution of the Galerkin equation, ${\displaystyle u_{n}}$

${\displaystyle a(\epsilon _{n},v_{n})=a(u,v_{n})-a(u_{n},v_{n})=f(v_{n})-f(v_{n})=0.}$

Matrix form of Galerkin's equation[]

Since the aim of Galerkin's method is the production of a linear system of equations, we build its matrix form, which can be used to compute the solution algorithmically.

Let ${\displaystyle e_{1},e_{2},\ldots ,e_{n}}$ be a basis for ${\displaystyle V_{n}}$. Then, it is sufficient to use these in turn for testing the Galerkin equation, i.e.: find ${\displaystyle u_{n}\in V_{n}}$ such that

${\displaystyle a(u_{n},e_{i})=f(e_{i})\quad i=1,\ldots ,n.}$

We expand ${\displaystyle u_{n}}$ with respect to this basis, ${\displaystyle u_{n}=\sum _{j=1}^{n}u_{j}e_{j}}$ and insert it into the equation above, to obtain

${\displaystyle a\left(\sum _{j=1}^{n}u_{j}e_{j},e_{i}\right)=\sum _{j=1}^{n}u_{j}a(e_{j},e_{i})=f(e_{i})\quad i=1,\ldots ,n.}$

This previous equation is actually a linear system of equations ${\displaystyle Au=f}$, where

${\displaystyle A_{ij}=a(e_{j},e_{i}),\quad f_{i}=f(e_{i}).}$

Symmetry of the matrix[]

Due to the definition of the matrix entries, the matrix of the Galerkin equation is symmetric if and only if the bilinear form ${\displaystyle a(\cdot ,\cdot )}$ is symmetric.

Analysis of Galerkin methods[]

Here, we will restrict ourselves to symmetric bilinear forms, that is

${\displaystyle a(u,v)=a(v,u).}$

While this is not really a restriction of Galerkin methods, the application of the standard theory becomes much simpler. Furthermore, a Petrov–Galerkin method may be required in the nonsymmetric case.

The analysis of these methods proceeds in two steps. First, we will show that the Galerkin equation is a well-posed problem in the sense of Hadamard and therefore admits a unique solution. In the second step, we study the quality of approximation of the Galerkin solution ${\displaystyle u_{n}}$.

The analysis will mostly rest on two properties of the bilinear form, namely

• Boundedness: for all ${\displaystyle u,v\in V}$ holds

  ${\displaystyle a(u,v)\leq C\|u\|\,\|v\|}$ for some constant ${\displaystyle C>0}$

• Ellipticity: for all ${\displaystyle u\in V}$ holds

  ${\displaystyle a(u,u)\geq c\|u\|^{2}}$ for some constant ${\displaystyle c>0.}$

By the Lax-Milgram theorem (see weak formulation), these two conditions imply well-posedness of the original problem in weak formulation. All norms in the following sections will be norms for which the above inequalities hold (these norms are often called an energy norm).

Well-posedness of the Galerkin equation[]

Since ${\displaystyle V_{n}\subset V}$, boundedness and ellipticity of the bilinear form apply to ${\displaystyle V_{n}}$. Therefore, the well-posedness of the Galerkin problem is actually inherited from the well-posedness of the original problem.

Quasi-best approximation (Céa's lemma)[]

The error ${\displaystyle u-u_{n}}$ between the original and the Galerkin solution admits the estimate

${\displaystyle \|u-u_{n}\|\leq {\frac {C}{c}}\inf _{v_{n}\in V_{n}}\|u-v_{n}\|.}$

This means, that up to the constant ${\displaystyle C/c}$, the Galerkin solution ${\displaystyle u_{n}}$ is as close to the original solution ${\displaystyle u}$ as any other vector in ${\displaystyle V_{n}}$. In particular, it will be sufficient to study approximation by spaces ${\displaystyle V_{n}}$, completely forgetting about the equation being solved.

Proof[]

Since the proof is very simple and the basic principle behind all Galerkin methods, we include it here: by ellipticity and boundedness of the bilinear form (inequalities) and Galerkin orthogonality (equals sign in the middle), we have for arbitrary ${\displaystyle v_{n}\in V_{n}}$:

${\displaystyle c\|u-u_{n}\|^{2}\leq a(u-u_{n},u-u_{n})=a(u-u_{n},u-v_{n})\leq C\|u-u_{n}\|\,\|u-v_{n}\|.}$

Dividing by ${\displaystyle c\|u-u_{n}\|}$ and taking the infimum over all possible ${\displaystyle v_{n}}$ yields the lemma.

Galerkin's best approximation property in the energy norm[]

For simplicity of presentation in the section above we have assumed that the bilinear form ${\displaystyle a(u,v)}$ is symmetric and positive definite, which implies that it is a scalar product and the expression ${\displaystyle \|u\|_{a}={\sqrt {a(u,u)}}}$ is actually a valid vector norm, called the energy norm. Under these assumptions one can easily prove in addition Galerkin's best approximation property in the energy norm.

Using Galerkin a-orthogonality and the Cauchy–Schwarz inequality for the energy norm, we obtain

${\displaystyle \|u-u_{n}\|_{a}^{2}=a(u-u_{n},u-u_{n})=a(u-u_{n},u-v_{n})\leq \|u-u_{n}\|_{a}\,\|u-v_{n}\|_{a}.}$

Dividing by ${\displaystyle \|u-u_{n}\|_{a}}$ and taking the infimum over all possible ${\displaystyle v_{n}\in V_{n}}$ proves that the Galerkin approximation ${\displaystyle u_{n}\in V_{n}}$ is the best approximation in the energy norm within the subspace ${\displaystyle V_{n}\subset V}$, i.e. ${\displaystyle u_{n}\in V_{n}}$ is nothing but the orthogonal, with respect to the scalar product ${\displaystyle a(u,v)}$, projection of the solution ${\displaystyle u}$ to the subspace ${\displaystyle V_{n}}$.

Galerkin method for stepped Structures[]

I. Elishakof, M. Amato, A. Marzani, P.A. Arvan, and J.N. Reddy ^[6][7][8][9] studied the application of the Galerkin method to stepped structures. They showed that the generalized function, namely unit-step function, Dirac’s delta function, and the doublet function are needed for obtaining accurate results.

History[]

The approach is usually credited to Boris Galerkin.^[10][11] The method was explained to the Western reader by Hencky^[12] and Duncan^[13][14] among others. Its convergence was studied by Mikhlin^[15] and Leipholz^{[16][17][18][19]} Its coincidence with Fourier method was illustrated by Elishakoff et al.^[20][21][22] Its equivalence to Ritz's method for conservative problems was shown by Singer.^[23] Gander and Wanner^[24] showed how Ritz and Galerkin methods led to the modern finite element method. One hundred years of method's development was discussed by Repin.^[25] Elishakoff, Kaplunov and Kaplunov^[26] show that the Galerkin’s method was not developed by Ritz, contrary to the Timoshenko’s statements.

See also[]

• Ritz method

References[]

External links[]

• "Galerkin method", Encyclopedia of Mathematics, EMS Press, 2001 [1994]
• Galerkin Method from MathWorld