Gram-Schmidt

Process

Given basis {v₁,…,vₙ}, produce orthonormal basis {u₁,…,uₙ}:

\[u_k=\frac{v_k-\sum_{{j

Examples

Example 1. Orthogonalize {(1,1),(1,0)}.

Solution. u₁=(1,1)/√2. u₂=(1,0)−½(1,1)=(½,−½), normalized=(1,−1)/√2.

In Depth

The Gram–Schmidt process converts any linearly independent set into an orthonormal basis. Orthonormal bases simplify nearly every computation: projections become dot products, the matrix of a linear map in an orthonormal basis is easier to analyze, and numerical algorithms are more stable.

Numerically, the classical Gram–Schmidt process can lose orthogonality due to floating-point errors. The modified Gram–Schmidt algorithm reorders the computation to maintain orthogonality more robustly. Householder reflections and Givens rotations are even more numerically stable alternatives used in production QR decomposition algorithms.

The Gram–Schmidt process is the constructive proof that every finite-dimensional inner product space has an orthonormal basis. In function spaces (Hilbert spaces), the analogous process produces orthogonal polynomials — Legendre, Chebyshev, Hermite — which are fundamental in approximation theory and numerical integration.

Further Reading & Context

The study of gram schmidt connects to many areas of mathematics and its applications. Understanding the foundational definitions and theorems provides the basis for advanced work in analysis, algebra, and applied mathematics.

Historical development: most mathematical concepts evolved over centuries, with contributions from mathematicians across many cultures. The modern axiomatic treatment provides rigor, while computational tools enable practical application.

In modern mathematics, this topic appears in graduate courses and research across pure and applied mathematics. Connections to computer science, physics, and engineering make it a versatile and important area of study. Mastery of the core results and techniques opens doors to research in number theory, analysis, geometry, and beyond.

Recommended next steps: work through the standard theorems with full proofs, explore the connections to related topics listed above, and practice with a variety of problems ranging from computational exercises to theoretical proofs. The interplay between different areas of mathematics is one of the subject's greatest rewards.

Deep Dive: Gram Schmidt

This lesson extends core ideas for gram schmidt with rigorous reasoning, edge-case checks, and application framing in linear algebra.

Practice Set

Practice. Derive one main result on this page and validate with a numeric or geometric check.

Goal. Confirm assumptions, transformation steps, and final interpretation.

References & Editorial Notes

  • Stewart, Calculus.
  • Strang, Introduction to Linear Algebra.
  • Apostol, Mathematical Analysis.

Last editorial review: 2026-04-14.