Next: Isomorphic Hilbert Spaces Up: Hilbert Spaces Previous: Subspace Approximation vs. the   Contents   Index

## Recapitulation

The optimal (or least squares) approximation to a square integrable function is uniquely determined by specifying a subspace in the Hilbert space. If one wishes to improve this optimal approximation, then the only way one can do this, in general, is to have a higher dimensional subspace, obtained by increasing the number of orthogonal spanning vectors. The quality of the approximation is measured by the squared magnitude of its error away from the given function.

Instead of judging the quality of an optimal approximation by its mean squared error, one can judge it by its length. The longer it is, the better. The length of an approximation in a subspace is not arbitrary. It is bounded from above, as we shall see presently. The closer an optimal approximation comes to this upper bound, the better the approximation.

What is happening geometrically is that our attention is shifting from the height of the right triangle to its hypotenuse and its base.

Indeed, from the right triangle, whose sides satisfy the vector eqation

one obtains the theorem of Pythagoras in Hilbert space:

See Figure 1.6 on page . This evidently yields

which is Bessel's inequality.

Using the optimal ( least square'') approximation

one obtains

which for our square integrable functions is

Geometrically this inequality says

Consider now a sequence of subspaces

the respective optimal approximations to the given function , and the corresponding sequence of least square errors

If approaches zero as tends to infinity, one obtains the following

Definition: The set of O.N. functions is said to be complete if

Thus the least squares approximation becomes exact in the limit of an infinite (generalized) Fourier series. From the Pythagorean theorem we therefore see that the Bessel's inequality becomes an equality

or

 (117)

This alternative completeness criterion is known as the completeness relation, or Parseval's relation.

Example (Spectral Decomposition of the Identity in ):

Let us apply the completeness relation to the Hilbert space of square integrable functions on , . Consider the fact that this relation implies (see homework set 1)

Explicitly, one has

This can be rewritten in terms of the Dirac delta function (which is developed in Section 2.2 starting on page ) as

This holds for all . Consequently, we have the following alternate form for the completeness of the set of orthonormal functions

or

in quantum mechanical notation.

Usually the orthonormal functions are the eigenfunctions of some operator (for example, the Sturm-Liouville operator boundary conditions, which we shall meet later). The Dirac delta function

can be viewed as the identity operator on the Hilbert space . Consequently, the alternate form of the completeness relation

 (118)

can be viewed as a spectral representation of the identity operator in .

Next: Isomorphic Hilbert Spaces Up: Hilbert Spaces Previous: Subspace Approximation vs. the   Contents   Index
Ulrich Gerlach 2010-12-09