Intuition
The dot product is not the only sensible way to measure lengths and angles. Any product obeying the same three rules works just as well, in any vector space, and everything proved from those rules carries over: lengths, angles, orthogonality and all that follows.
Distances on a map can be measured in miles or in hours of walking, which weighs uphill paths more heavily. Both are honest measures, and both obey the same rules of distance.
Inner products
An inner product on a vector space gives every pair of vectors a number that is symmetric, linear in each slot, and positive: for every . Lengths, distances, angles and orthogonality are then defined from it exactly as from the dot product. Every proof so far in this chapter used only these three rules, so Cauchy–Schwarz, Pythagoras and the independence of orthogonal vectors hold for every inner product.
Examples
- The dot product on , and weighted versions such as on .
An inner product is a matrix in coordinates
Write and in a basis and expand the inner product by linearity in each slot. What is left is a double sum of the coordinates weighted by the numbers , which is a matrix product. That matrix , the Gram matrix, is symmetric because the inner product is; for the dot product and the standard basis it is .
Proof steps
Write both vectors in the basis.
Linearity in each slot expands the inner product term by term.
That double sum is the product of a row, a matrix and a column.
, so is symmetric.
Applications
Practice
Three Rules
A formula is an inner product when it is symmetric, linear in each slot, and positive on every non-zero vector. The last is the one most often missed.
Try it
Which formula is an inner product on ?
Try it
With on , what is ?
Inner Products of Polynomials
On , multiplies the values at , and and adds, like a dot product of the lists of values.
Try it
With on , which polynomial is orthogonal to the constant ?
Try it
With on , what is ?
Try it
is an inner product on .
Try it
With on matrices, what is ?
Try it
The Cauchy–Schwarz inequality holds for every inner product.
Try it
What is the Gram matrix of the dot product in the basis , of ?
What You Learned
- An inner product is symmetric, linear in each slot and positive on non-zero vectors.
- Length, angle and orthogonality come from it as from the dot product: .
- Examples: weighted dot products, sums of values of polynomials, .
Final checkpoint
Try it
With on , what is the length of ?
Try it
With on , which vector is orthogonal to ?
Try it
The dot product is one inner product on among many.
Completion
Lesson complete
Great work! You now know how to:
- check the three rules of an inner product;
- compute inner products on vectors, polynomials and matrices;
- use lengths and orthogonality relative to an inner product;
- write an inner product as its Gram matrix.