maths.free › Linear Algebra › 5. Determinants › Determinant of a Matrix
Determinant of a Matrix
Before we define the determinant of a matrix, we take a slight detour to introduce elementary matrices. These will bring us back to the beginning of the course and our old friend, row operations.
Determinant of a Matrix
Before we define the determinant of a matrix, we take a slight detour to introduce elementary matrices. These will bring us back to the beginning of the course and our old friend, row operations.
- Construct the elementary matrix that will effect the row operation $\rowopadd{-6}{2}{3}$ on a $4\times 7$ matrix.
- \begin{bmatrix} 2&3&-1\\ 3&8&2\\ 4&-1&-3 \end{bmatrix}
- \begin{bmatrix} 3 & 9 & -2 & 4 & 2 \\ 0 & 1 & 4 & -2 & 7 \\ 0 & 0 & -2 & 5 & 2 \\ 0 & 0 & 0 & -1 & 6 \\ 0 & 0 & 0 & 0 & 4 \end{bmatrix}
Elementary Matrices
Elementary matrices are very simple, as you might have suspected from their name. Their purpose is to effect row operations () on a matrix through matrix multiplication (). Their definitions look much more complicated than they really are, so be sure to skip over them on your first reading and head right for the explanation that follows and the first example.
Again, these matrices are not as complicated as their definitions suggest, since they are just small perturbations of the $n\times n$ identity matrix (). $\elemswap{i}{j}$ is the identity matrix with rows (or columns) $i$ and $j$ trading places, $\elemmult{\alpha}{i}$ is the identity matrix where the diagonal entry in row $i$ and column $i$ has been replaced by $\alpha$, and $\elemadd{\alpha}{i}{j}$ is the identity matrix where the entry in row $j$ and column $i$ has been replaced by $\alpha$. (Yes, those subscripts look backwards in the description of $\elemadd{\alpha}{i}{j}$). Notice that our notation makes no reference to the size of the elementary matrix, since this will always be apparent from the context, or unimportant.
The raison d'etre for elementary matrices is to do row operations on matrices with matrix multiplication. So here is an example where we will both see some elementary matrices and see how they accomplish row operations when used with matrix multiplication.
The next three theorems establish that each elementary matrix effects a row operation via matrix multiplication.
Later in this section we will need two facts about elementary matrices.
Notice that we have now made use of the nonzero restriction on $\alpha$ in the definition of $\elemmult{\alpha}{i}$. One more key property of elementary matrices.
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Definition of the Determinant
We will now turn to the definition of a determinant and do some sample computations. The definition of the determinant function is recursive, that is, the determinant of a large matrix is defined in terms of the determinant of smaller matrices. To this end, we will make a few definitions.
Example: Some submatrices
For the matrix A= \begin{bmatrix} 1 & -2 & 3 & 9\\ 4 & -2 & 0 & 1\\ 3 & 5 & 2 & 1 \end{bmatrix} we have the submatrices \submatrix{A}{2}{3} = \begin{bmatrix} 1 & -2 & 9\\ 3 & 5 & 1 \end{bmatrix} && \submatrix{A}{3}{1} = \begin{bmatrix} -2 & 3 & 9\\ -2 & 0 & 1 \end{bmatrix}
So to compute the determinant of a $5\times 5$ matrix we must build 5 submatrices, each of size $4$. To compute the determinants of each the $4\times 4$ matrices we need to create 4 submatrices each, these now of size $3$ and so on. To compute the determinant of a $10\times 10$ matrix would require computing the determinant of $10!=10\times 9\times 8\times 7\times 6\times 5\times 4\times 3\times 2=3,628,800$ $1\times 1$ matrices. Fortunately there are better ways. However this does suggest an excellent computer programming exercise to write a recursive procedure to compute a determinant.
Let us compute the determinant of a reasonably sized matrix by hand.
In practice it is a bit silly to decompose a $2\times 2$ matrix down into a couple of $1\times 1$ matrices and then compute the exceedingly easy determinant of these puny matrices. So here is a simple theorem.
Do you recall seeing the expression $ad-bc$ before? (Hint: )
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Computing Determinants
There are a variety of ways to compute the determinant. We will establish first that we can choose to mimic our definition of the determinant, but by using matrix entries and submatrices based on a row other than the first one.
We can also obtain a formula that computes a determinant by expansion about a column, but this will be simpler if we first prove a result about the interplay of determinants and transposes. Notice how the following proof makes use of the ability to compute a determinant by expanding about any row.
Now we can easily get the result that a determinant can be computed by expansion about any column as well.
That the determinant of an $n\times n$ matrix can be computed in $2n$ different (albeit similar) ways is nothing short of remarkable. For the doubters among us, we will do an example, computing a $4\times 4$ matrix in two different ways.
When a matrix has all zeros above (or below) the diagonal, exploiting the zeros by expanding about the proper row or column makes computing a determinant insanely easy.
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Symbols used here
Add a_k for k = 1 up to n.
n × (n−1) × … × 1; the number of orderings of n things. 0! = 1.
Scaling factor of area/volume under A; zero means singular.
A rectangular array of numbers; a linear map.
i² = −1.
Inequalities that allow equality; < and > exclude it.
The two sides are different.
A quantity with magnitude and direction; a column of numbers.
The matrix that undoes A; A with rows and columns swapped.
The factor by which an eigenvector is stretched: Av = λv.
Σ u_i v_i; the length of v, √(v·v).
Questions people ask
What does a determinant mean geometrically?
It is the factor by which the matrix scales area (2×2) or volume (3×3), with a negative sign if orientation flips. Zero means the matrix flattens space and cannot be undone.
What is an eigenvector?
A direction the matrix does not turn — it only stretches it by the eigenvalue. Along eigenvectors a complicated matrix acts like multiplication by a number.
Why is matrix multiplication not commutative?
Because a matrix is a transformation and AB means "do B, then A". Rotating then reflecting is not the same as reflecting then rotating.
ჲოთრაი ჟამ.
Parts of this page are adapted from Beezer, A First Course in Linear Algebra (GFDL 1.2). Condensed and re-explained here; errors are ours.
მეტი Linear Algebra
DeterminantsMatrix inverseEigenvalues and eigenvectorsMatrix multiplicationRow reductionVector spaces, span and linear independenceOrthogonality, projections and least squaresDiagonalisation and matrix powersLinear transformations and change of basis