Inner Products

Definition

An inner product ⟨·,·⟩ satisfies linearity, symmetry, and positive-definiteness. Induces norm \(\|v\|=\sqrt{\langle v,v\rangle}\).

Examples

In Depth

An inner product on a vector space \(V\) over \(\mathbb{R}\) (or \(\mathbb{C}\)) is a map \(\langle\cdot,\cdot\rangle:V\times V\to\mathbb{R}\) satisfying linearity in the first argument, symmetry (\(\langle u,v\rangle=\langle v,u\rangle\)), and positive definiteness (\(\langle v,v\rangle>0\) for \(v\neq0\)). It generalizes the dot product.

The standard inner product on \(\mathbb{R}^n\) is \(\langle\mathbf{u},\mathbf{v}\rangle=\mathbf{u}^T\mathbf{v}=\sum u_iv_i\). On \(L^2[a,b]\): \(\langle f,g\rangle=\int_a^b f(x)g(x)\,dx\). The induced norm is \(\|v\|=\sqrt{\langle v,v\rangle}\).

The Cauchy–Schwarz inequality: \(|\langle u,v\rangle|\leq\|u\|\|v\|\), with equality iff \(u\) and \(v\) are proportional. This implies the triangle inequality \(\|u+v\|\leq\|u\|+\|v\|\) and is one of the most widely used inequalities in mathematics.

The angle between vectors: \(\cos\theta=\langle u,v\rangle/(\|u\|\|v\|)\). Vectors are orthogonal iff \(\langle u,v\rangle=0\). The Gram–Schmidt process converts any basis to an orthonormal one by successive orthogonalization and normalization.

Inner product spaces (Hilbert spaces when complete) are the natural setting for quantum mechanics (states are unit vectors, observables are self-adjoint operators), signal processing (Fourier analysis uses the \(L^2\) inner product), and machine learning (kernel methods implicitly compute inner products in high-dimensional feature spaces).

Key Properties & Applications

The polarization identity recovers the inner product from the norm: \(\langle u,v\rangle=\frac{1}{4}(\|u+v\|^2-\|u-v\|^2)\). This shows that in an inner product space, the norm determines the inner product. Not every norm comes from an inner product (the parallelogram law \(\|u+v\|^2+\|u-v\|^2=2\|u\|^2+2\|v\|^2\) must hold).

Reproducing kernel Hilbert spaces (RKHS) are inner product spaces of functions where evaluation is a continuous linear functional. The kernel \(K(x,y)=\langle\phi(x),\phi(y)\rangle\) computes inner products in a (possibly infinite-dimensional) feature space. This is the 'kernel trick' in machine learning.

The spectral theorem for compact self-adjoint operators on a Hilbert space: every such operator has a countable orthonormal eigenbasis with eigenvalues converging to 0. This generalizes the finite-dimensional spectral theorem and underlies Fourier analysis and quantum mechanics.

Further Reading & Context

The study of inner product connects to many areas of mathematics and its applications. Understanding the foundational definitions and theorems provides the basis for advanced work in analysis, algebra, and applied mathematics.

Historical development: most mathematical concepts evolved over centuries, with contributions from mathematicians across many cultures. The modern axiomatic treatment provides rigor, while computational tools enable practical application.

In modern mathematics, this topic appears in graduate courses and research across pure and applied mathematics. Connections to computer science, physics, and engineering make it a versatile and important area of study. Mastery of the core results and techniques opens doors to research in number theory, analysis, geometry, and beyond.

Recommended next steps: work through the standard theorems with full proofs, explore the connections to related topics listed above, and practice with a variety of problems ranging from computational exercises to theoretical proofs. The interplay between different areas of mathematics is one of the subject's greatest rewards.

Deep Dive: Inner Product

This lesson extends core ideas for inner product with rigorous reasoning, edge-case checks, and application framing in linear algebra.

Practice Set

References & Editorial Notes

• Stewart, Calculus.
• Strang, Introduction to Linear Algebra.
• Apostol, Mathematical Analysis.

Last editorial review: 2026-04-14.