Invariant subspace

In mathematics, an invariant subspace of a linear mapping T : V → V from some vector space V to itself, is a subspace W of V that is preserved by T; that is, T(W) ⊆ W.

General description[]

Consider a linear mapping ${\displaystyle T}$

${\displaystyle T:\mathbb {R} ^{n}\to \mathbb {R} ^{n}.}$

An invariant subspace ${\displaystyle W}$ of ${\displaystyle T}$ has the property that all vectors ${\displaystyle \mathbf {v} \in W}$ are transformed by ${\displaystyle T}$ into vectors also contained in ${\displaystyle W}$. This can be stated as

${\displaystyle \mathbf {v} \in W\implies T(\mathbf {v} )\in W.}$

Trivial examples of invariant subspaces[]

• ${\displaystyle \mathbb {R} ^{n}}$: Since ${\displaystyle T}$ maps every vector in ${\displaystyle \mathbb {R} ^{n}}$ into ${\displaystyle \mathbb {R} ^{n}.}$
• ${\displaystyle \{0\}}$: Since a linear map has to map ${\displaystyle 0\mapsto 0.}$

1-dimensional invariant subspace U[]

A basis of a 1-dimensional space is simply a non-zero vector ${\displaystyle \mathbf {v} }$. Consequently, any vector ${\displaystyle \mathbf {x} \in U}$ can be represented as ${\displaystyle \lambda \mathbf {v} }$ where ${\displaystyle \lambda }$ is a scalar. If we represent ${\displaystyle T}$ by a matrix ${\displaystyle A}$ then, for ${\displaystyle U}$ to be an invariant subspace it must satisfy

${\displaystyle \forall \mathbf {x} \in U\;\exists \alpha \in \mathbb {R} :A\mathbf {x} =\alpha \mathbf {v} .}$

We know that ${\displaystyle \mathbf {x} \in U\Rightarrow \mathbf {x} =\beta \mathbf {v} }$ with ${\displaystyle \beta \in \mathbb {R} }$.

Therefore, the condition for existence of a 1-dimensional invariant subspace is expressed as:

${\displaystyle A\mathbf {v} =\lambda \mathbf {v} }$, where ${\displaystyle \lambda }$ is a scalar (in the base field of the vector space.

Note that this is the typical formulation of an eigenvalue problem, which means that any eigenvector of ${\displaystyle A}$ forms a 1-dimensional invariant subspace in ${\displaystyle T}$.

Formal description[]

An invariant subspace of a linear mapping

${\displaystyle T:V\to V}$

from some vector space V to itself is a subspace W of V such that T(W) is contained in W. An invariant subspace of T is also said to be T invariant.

If W is T-invariant, we can restrict T to W to arrive at a new linear mapping

${\displaystyle T|_{W}:W\to W.}$

This linear mapping is called the restriction of T on W and is defined by

${\displaystyle T|_{W}(\mathbf {x} )=T(\mathbf {x} ){\text{ for all }}\mathbf {x} \in W.}$

Next, we give a few immediate examples of invariant subspaces.

Certainly V itself, and the subspace {0}, are trivially invariant subspaces for every linear operator T : V → V. For certain linear operators there is no non-trivial invariant subspace; consider for instance a rotation of a two-dimensional real vector space.

Let v be an eigenvector of T, i.e. T v = λv. Then W = span{v} is T-invariant. As a consequence of the fundamental theorem of algebra, every linear operator on a nonzero finite-dimensional complex vector space has an eigenvector. Therefore, every such linear operator has a non-trivial invariant subspace. The fact that the complex numbers are an algebraically closed field is required here. Comparing with the previous example, one can see that the invariant subspaces of a linear transformation are dependent upon the base field of V.

An invariant vector (i.e. a fixed point of T), other than 0, spans an invariant subspace of dimension 1. An invariant subspace of dimension 1 will be acted on by T by a scalar and consists of invariant vectors if and only if that scalar is 1.

As the above examples indicate, the invariant subspaces of a given linear transformation T shed light on the structure of T. When V is a finite-dimensional vector space over an algebraically closed field, linear transformations acting on V are characterized (up to similarity) by the Jordan canonical form, which decomposes V into invariant subspaces of T. Many fundamental questions regarding T can be translated to questions about invariant subspaces of T.

More generally, invariant subspaces are defined for sets of operators as subspaces invariant for each operator in the set. Let L(V) denote the algebra of linear transformations on V, and Lat(T) be the family of subspaces invariant under T ∈ L(V). (The "Lat" notation refers to the fact that Lat(T) forms a lattice; see discussion below.) Given a nonempty set Σ ⊂ L(V), one considers the invariant subspaces invariant under each T ∈ Σ. In symbols,

${\displaystyle \operatorname {Lat} (\Sigma )=\bigcap _{T\in \Sigma }\operatorname {Lat} (T).}$

For instance, it is clear that if Σ = L(V), then Lat(Σ) = { {0}, V }.

Given a representation of a group G on a vector space V, we have a linear transformation T(g) : V → V for every element g of G. If a subspace W of V is invariant with respect to all these transformations, then it is a subrepresentation and the group G acts on W in a natural way.

As another example, let T ∈ L(V) and Σ be the algebra generated by {1, T }, where 1 is the identity operator. Then Lat(T) = Lat(Σ). Because T lies in Σ trivially, Lat(Σ) ⊂ Lat(T). On the other hand, Σ consists of polynomials in 1 and T, and therefore the reverse inclusion holds as well.

Matrix representation[]

Over a finite-dimensional vector space, every linear transformation T : V → V can be represented by a matrix once a basis of V has been chosen.

Suppose now W is a T-invariant subspace. Pick a basis C = {v₁, ..., v_k} of W and complete it to a basis B of V. Then, with respect to this basis, the matrix representation of T takes the form:

${\displaystyle T={\begin{bmatrix}T_{11}&T_{12}\\0&T_{22}\end{bmatrix}}}$

where the upper-left block T₁₁ is the restriction of T to W.

In other words, given an invariant subspace W of T, V can be decomposed into the direct sum

${\displaystyle V=W\oplus W'.}$

Viewing T as an operator matrix

${\displaystyle T={\begin{bmatrix}T_{11}&T_{12}\\T_{21}&T_{22}\end{bmatrix}}:{\begin{matrix}W\\\oplus \\W'\end{matrix}}\rightarrow {\begin{matrix}W\\\oplus \\W'\end{matrix}},}$

it is clear that T₂₁: W → W' must be zero.

Determining whether a given subspace W is invariant under T is ostensibly a problem of geometric nature. Matrix representation allows one to phrase this problem algebraically. The projection operator P onto W is defined by P(w + w′) = w, where w ∈ W and w′ ∈ W'. The projection P has matrix representation

${\displaystyle P={\begin{bmatrix}1&0\\0&0\end{bmatrix}}:{\begin{matrix}W\\\oplus \\W'\end{matrix}}\rightarrow {\begin{matrix}W\\\oplus \\W'\end{matrix}}.}$

A straightforward calculation shows that W = ran P, the range of P, is invariant under T if and only if PTP = TP. In other words, a subspace W being an element of Lat(T) is equivalent to the corresponding projection satisfying the relation PTP = TP.

If P is a projection (i.e. P² = P) then so is 1 − P, where 1 is the identity operator. It follows from the above that TP = PT if and only if both ran P and ran(1 − P) are invariant under T. In that case, T has matrix representation

${\displaystyle T={\begin{bmatrix}T_{11}&0\\0&T_{22}\end{bmatrix}}:{\begin{matrix}\operatorname {Ran} P\\\oplus \\\operatorname {Ran} (1-P)\end{matrix}}\rightarrow {\begin{matrix}\operatorname {Ran} P\\\oplus \\\operatorname {Ran} (1-P)\end{matrix}}\;.}$

Colloquially, a projection that commutes with T "diagonalizes" T.

Invariant subspace problem[]

Main article: Invariant subspace problem

The invariant subspace problem concerns the case where V is a separable Hilbert space over the complex numbers, of dimension > 1, and T is a bounded operator. The problem is to decide whether every such T has a non-trivial, closed, invariant subspace. This problem is unsolved as of 2021.

In the more general case where V is assumed to be a Banach space, there is an example of an operator without an invariant subspace due to Per Enflo (1976). A concrete example of an operator without an invariant subspace was produced in 1985 by Charles Read.

Invariant-subspace lattice[]

Given a nonempty set Σ ⊂ L(V), the invariant subspaces invariant under each element of Σ form a lattice, sometimes called the invariant-subspace lattice of Σ and denoted by Lat(Σ).

The lattice operations are defined in a natural way: for Σ′ ⊂ Σ, the meet operation is defined by

${\displaystyle \bigwedge _{W\in \Sigma '}W=\bigcap _{W\in \Sigma '}W}$

while the join operation is defined by

${\displaystyle \bigvee _{W\in \Sigma '}W=\operatorname {span} \bigcup _{W\in \Sigma '}W.}$

A minimal element in Lat(Σ) in said to be a minimal invariant subspace.

Fundamental theorem of noncommutative algebra[]

Just as the fundamental theorem of algebra ensures that every linear transformation acting on a finite-dimensional complex vector space has a nontrivial invariant subspace, the fundamental theorem of noncommutative algebra asserts that Lat(Σ) contains nontrivial elements for certain Σ.

Theorem (Burnside) Assume V is a complex vector space of finite dimension. For every proper subalgebra Σ of L(V), Lat(Σ) contains a nontrivial element.

Burnside's theorem is of fundamental importance in linear algebra. One consequence is that every commuting family in L(V) can be simultaneously upper-triangularized.

A nonempty set Σ ⊂ L(V) is said to be triangularizable if there exists a basis {e₁, ..., e_n} of V such that

${\displaystyle \operatorname {span} \{e_{1},\ldots ,e_{k}\}\in \operatorname {Lat} (\Sigma )\ {\text{ for all }}\ k\geq 1\;.}$

In other words, Σ is triangularizable if there exists a basis such that every element of Σ has an upper-triangular matrix representation in that basis. It follows from Burnside's theorem that every commutative algebra Σ in L(V) is triangularizable. Hence every commuting family in L(V) can be simultaneously upper-triangularized.

Left ideals[]

If A is an algebra, one can define a left regular representation Φ on A: Φ(a)b = ab is a homomorphism from A to L(A), the algebra of linear transformations on A

The invariant subspaces of Φ are precisely the left ideals of A. A left ideal M of A gives a subrepresentation of A on M.

If M is a left ideal of A then the left regular representation Φ on M now descends to a representation Φ' on the quotient vector space A/M. If [b] denotes an equivalence class in A/M, Φ'(a)[b] = [ab]. The kernel of the representation Φ' is the set {a ∈ A | ab ∈ M for all b}.

The representation Φ' is irreducible if and only if M is a maximal left ideal, since a subspace V ⊂ A/M is an invariant under {Φ'(a) | a ∈ A} if and only if its preimage under the quotient map, V + M, is a left ideal in A.

Almost-invariant halfspaces[]

Related to invariant subspaces are so-called almost-invariant-halfspaces (AIHS's). A closed subspace ${\displaystyle Y}$ of a Banach space ${\displaystyle X}$ is said to be almost-invariant under an operator ${\displaystyle T\in {\mathcal {B}}(X)}$ if ${\displaystyle TY\subseteq Y+E}$ for some finite-dimensional subspace ${\displaystyle E}$; equivalently, ${\displaystyle Y}$ is almost-invariant under ${\displaystyle T}$ if there is a finite-rank operator ${\displaystyle F\in {\mathcal {B}}(X)}$ such that ${\displaystyle (T+F)Y\subseteq Y}$, i.e. if ${\displaystyle Y}$ is invariant (in the usual sense) under ${\displaystyle T+F}$. In this case, the minimum possible dimension of ${\displaystyle E}$ (or rank of ${\displaystyle F}$) is called the defect.

Clearly, every finite-dimensional and finite-codimensional subspace is almost-invariant under every operator. Thus, to make things nontrivial, we say that ${\displaystyle Y}$ is a halfspace whenever it is a closed subspace with infinite dimension and infinite codimension.

The AIHS problem asks whether every operator admits an AIHS. In the complex setting it has already been solved; that is, if ${\displaystyle X}$ is a complex infinite-dimensional Banach space and ${\displaystyle T\in {\mathcal {B}}(X)}$ then ${\displaystyle T}$ admits an AIHS of defect at most 1. It is not currently known whether the same holds if ${\displaystyle X}$ is a real Banach space. However, some partial results have been established: for instance, any self-adjoint operator on an infinite-dimensional real Hilbert space admits an AIHS, as does any strictly singular (or compact) operator acting on a real infinite-dimensional reflexive space.

See also[]

• Invariant manifold

Bibliography[]

• Abramovich, Yuri A.; Aliprantis, Charalambos D. (2002). An Invitation to Operator Theory. American Mathematical Society. ISBN 978-0-8218-2146-6.

• Beauzamy, Bernard (1988). Introduction to Operator Theory and Invariant Subspaces. North Holland.

• Enflo, Per; Lomonosov, Victor (2001). "Some aspects of the invariant subspace problem". Handbook of the geometry of Banach spaces. I. Amsterdam: North-Holland. pp. 533–559.

• Gohberg, Israel; Lancaster, Peter; Rodman, Leiba (2006). Invariant Subspaces of Matrices with Applications. Classics in Applied Mathematics. 51 (Reprint, with list of errata and new preface, of the 1986 Wiley ed.). Society for Industrial and Applied Mathematics (SIAM). pp. xxii+692. ISBN 978-0-89871-608-5.

• Lyubich, Yurii I. (1988). Introduction to the Theory of Banach Representations of Groups (Translated from the 1985 Russian-language ed.). Kharkov, Ukraine: Birkhäuser Verlag.

• Radjavi, Heydar; Rosenthal, Peter (2003). Invariant Subspaces (Update of 1973 Springer-Verlag ed.). Dover Publications. ISBN 0-486-42822-2.