maths.freeLinear Algebra › 1. Systems of Linear Equations › Homogeneous Systems of Equations

Homogeneous Systems of Equations

In this section we specialize to systems of linear equations where every equation has a zero as its constant term.

Homogeneous Systems of Equations

In this section we specialize to systems of linear equations where every equation has a zero as its constant term. Along the way, we will begin to express more and more ideas in the language of matrices and begin a move away from writing out whole systems of equations. The ideas initiated in this section will carry through the remainder of the course.

  1. always
  2. Suppose a homogeneous system of equations has 13 variables and 8 equations. How many solutions will it have? Why?
  3. Describe, using only words, the null space of a matrix. (So in particular, do not use any symbols.)

For Exercises C21-C23, solve the given homogeneous linear system. Compare your results to the results of the corresponding exercise in .

For Exercises C25-C27, solve the given homogeneous linear system. Compare your results to the results of the corresponding exercise in .

For Exercises M50M52 say as much as possible about each system's solution set. Be sure to make it clear which theorems you are using to reach your conclusions.

Solutions of Homogeneous Systems

As usual, we begin with a definition.

Example: Archetype C as a homogeneous system

For each archetype that is a system of equations, we have formulated a similar, yet different, homogeneous system of equations by replacing each equation's constant term with a zero. To wit, for , we can convert the original system of equations into the homogeneous system,

Can you quickly find a solution to this system without row-reducing the augmented matrix?

As you might have discovered by studying , setting each variable to zero will always be a solution of a homogeneous system. This is the substance of the following theorem.

Since this solution is so obvious, we now define it as the trivial solution.

Here are three typical examples, which we will reference throughout this section. Work through the row operations as we bring each to reduced row-echelon form. Also notice what is similar in each example, and what differs.

Example: Homogeneous, unique solution, Archetype B

Archetype B can be converted to the homogeneous system, whose augmented matrix row-reduces to

By , the system is consistent, and so the computation $n-r=3-3=0$ means the solution set contains just a single solution. Then, this lone solution must be the trivial solution.

Example: Homogeneous, infinite solutions, Archetype A

can be converted to the homogeneous system, whose augmented matrix row-reduces to

By , the system is consistent, and so the computation $n-r=3-2=1$ means the solution set contains one free variable by , and hence has infinitely many solutions. We can describe this solution set using the free variable $x_3$, S=\setparts{\colvector{x_1\\x_2\\x_3}}{x_1=-x_3,\,x_2=x_3} =\setparts{\colvector{-x_3\\x_3\\x_3}}{x_3\in\complex{\null}}

Geometrically, these are points in three dimensions that lie on a line through the origin.

Condensed — the full section is in Beezer, A First Course in Linear Algebra.

Null Space of a Matrix

The set of solutions to a homogeneous system (which by is never empty) is of enough interest to warrant its own name. However, we define it as a property of the coefficient matrix, not as a property of some system of equations.

In the Archetypes () each example that is a system of equations also has a corresponding homogeneous system of equations listed, and several sample solutions are given. These solutions will be elements of the null space of the coefficient matrix. We will look at one example.

Example: Null space elements of Archetype I

The write-up for lists several solutions of the corresponding homogeneous system. Here are two, written as solution vectors. We can say that they are in the null space of the coefficient matrix for the system of equations in . \vect{x}=\colvector{3\\0\\-5\\-6\\0\\0\\1}&& \vect{y}=\colvector{-4\\1\\-3\\-2\\1\\1\\1}

However, the vector \vect{z}=\colvector{1\\0\\0\\0\\0\\0\\2} is not in the null space, since it is not a solution to the homogeneous system. For example, it fails to even make the first equation true.

Here are two (prototypical) examples of the computation of the null space of a matrix.

Example: Computing a null space, no. 1

Let us compute the null space of A=\begin{bmatrix} 2 & -1 & 7 & -3 & -8 \\ 1 & 0 & 2 & 4 & 9 \\ 2 & 2 & -2 & -1 & 8 \end{bmatrix} which we write as $\nsp{A}$. Translating , we simply desire to solve the homogeneous system $\homosystem{A}$. So we row-reduce the augmented matrix to obtain \begin{bmatrix} \leading{1} & 0 & 2 & 0 & 1 & 0 \\ 0 & \leading{1} & -3 & 0 & 4 & 0 \\ 0 & 0 & 0 & \leading{1} & 2 & 0 \end{bmatrix}

The variables (of the homogeneous system) $x_3$ and $x_5$ are free (since columns 1, 2 and 4 are pivot columns), so we arrange the equations represented by the matrix in reduced row-echelon form to x_1&=-2x_3-x_5\\ x_2&=3x_3-4x_5\\ x_4&=-2x_5\\

So we can write the infinite solution set as sets using column vectors, \nsp{A}=\setparts{ \colvector{-2x_3-x_5\\3x_3-4x_5\\x_3\\-2x_5\\x_5} }{ x_3,\,x_5\in\complex{\null} }

Condensed — the full section is in Beezer, A First Course in Linear Algebra.

Symbols used here

A = \begin{pmatrix} a & b \\ c & d \end{pmatrix}
matrix
A rectangular array of numbers; a linear map.
\leq,\ \geq
less/greater than or equal
Inequalities that allow equality; < and > exclude it.
\mathbf{v},\ \vec{v}
vector
A quantity with magnitude and direction; a column of numbers.
\det A,\ |A|
determinant
Scaling factor of area/volume under A; zero means singular.
A^{-1},\ A^{T}
inverse, transpose
The matrix that undoes A; A with rows and columns swapped.
\lambda
lambda (eigenvalue)
The factor by which an eigenvector is stretched: Av = λv.
\mathbf{u} \cdot \mathbf{v},\ \|\mathbf{v}\|
dot product, norm
Σ u_i v_i; the length of v, √(v·v).

Questions people ask

What does a determinant mean geometrically?

It is the factor by which the matrix scales area (2×2) or volume (3×3), with a negative sign if orientation flips. Zero means the matrix flattens space and cannot be undone.

What is an eigenvector?

A direction the matrix does not turn — it only stretches it by the eigenvalue. Along eigenvectors a complicated matrix acts like multiplication by a number.

Why is matrix multiplication not commutative?

Because a matrix is a transformation and AB means "do B, then A". Rotating then reflecting is not the same as reflecting then rotating.

स्वतःचा प्रयत्न करा

Parts of this page are adapted from Beezer, A First Course in Linear Algebra (GFDL 1.2). Condensed and re-explained here; errors are ours.

अधिक माहिती Linear Algebra