maths.free › Linear Algebra › 7. Linear Transformations › Injective Linear Transformations
Injective Linear Transformations
Some linear transformations possess one, or both, of two key properties, which go by the names injective and surjective.
Injective Linear Transformations
Some linear transformations possess one, or both, of two key properties, which go by the names injective and surjective. We will see that they are closely related to ideas like linear independence and spanning, and subspaces like the null space and the column space. In this section we will define an injective linear transformation and analyze the resulting consequences. The next section will do the same for the surjective property. In the final section of this chapter we will see what happens when we have the two properties simultaneously.
- Suppose $\ltdefn{T}{\complex{8}}{\complex{5}}$ is a linear transformation. Why is $T$ not injective?
- Describe the kernel of an injective linear transformation.
Injective Linear Transformations
As usual, we lead with a definition.
Given an arbitrary function, it is possible for two different inputs to yield the same output (think about the function $f(x)=x^2$ and the inputs $x=3$ and $x=-3$). For an injective function, this never happens. If we have equal outputs ($\lt{T}{\vect{x}}=\lt{T}{\vect{y}}$) then we must have achieved those equal outputs by employing equal inputs ($\vect{x}=\vect{y}$). Some authors prefer the term one-to-one where we use injective, and we will sometimes refer to an injective linear transformation as an injection.
Examples of Injective Linear Transformations
It is perhaps most instructive to examine a linear transformation that is not injective first.
Example: Not injective, Archetype Q
is the linear transformation
Notice that for \vect{x}&=\colvector{1\\3\\-1\\2\\4}& \vect{y}&=\colvector{4\\7\\0\\5\\7} we have \lt{T}{\colvector{1\\3\\-1\\2\\4}}&=\colvector{4\\55\\72\\77\\31}& \lt{T}{\colvector{4\\7\\0\\5\\7}}&=\colvector{4\\55\\72\\77\\31}
So we have two vectors from the domain, $\vect{x}\neq\vect{y}$, yet $\lt{T}{\vect{x}}=\lt{T}{\vect{y}}$, in violation of . This is another example where you should not concern yourself with how $\vect{x}$ and $\vect{y}$ were selected, as this will be explained shortly. However, do understand why these two vectors provide enough evidence to conclude that $T$ is not injective.
Here is a cartoon of a non-injective linear transformation. Notice that the central feature of this cartoon is that $\lt{T}{\vect{u}}=\vect{v}=\lt{T}{\vect{w}}$. Even though this happens again with some unnamed vectors, it only takes one occurrence to destroy the possibility of injectivity. Note also that the two vectors displayed in the bottom of $V$ have no bearing, either way, on the injectivity of $T$. Non-Injective Linear Transformation \tikzset{ltvect/.style={shape=circle, minimum size=0.30em, inner sep=0pt, draw, fill=black}} \tikzset{ltedge/.style={->, bend left=20, thick, shorten <=0.1em, shorten >=0.1em}} \draw ( 5em, 8em) circle [x radius=5em, y radius=8em, thick]; \draw (20em, 8em) circle [x radius=5em, y radius=8em, thick]; \node (U) at ( 5em, -1em) {$U$}; \node (V) at (20em, -1em) {$V$}; \draw[->, thick, draw] (U) to node[auto] {$T$} (V); \node (u1) [ltvect] at (5em, 13em) {}; \node (u2) [ltvect] at (5em, 11em) {}; \node (u) [ltvect, label=left:$\vect{u}$] at (5em, 8em) {}; \node (w) [ltvect, label=left:$\vect{w}$] at (5em, 6em) {}; \node (v1) [ltvect] at (20em, 12em) {}; \node (v) [ltvect, label=right:$\vect{v}$] at (20em, 7em) {}; \node (v2) [ltvect] at (19em, 3em) {}; \node (v3) [ltvect] at (21em, 3em) {}; \draw[ltedge] (u1) to (v1); \draw[ltedge] (u2) to (v1); \draw[ltedge] (u) to (v); \draw[ltedge] (w) to (v);
To show that a linear transformation is not injective, it is enough to find a single pair of inputs that get sent to the identical output, as in . However, to show that a linear transformation is injective we must establish that this coincidence of outputs never occurs. Here is an example that shows how to establish this.
Let us now examine an injective linear transformation between abstract vector spaces.
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Kernel of a Linear Transformation
For a linear transformation $\ltdefn{T}{U}{V}$, the kernel is a subset of the domain $U$. Informally, it is the set of all inputs that the transformation sends to the zero vector of the codomain. It will have some natural connections with the null space of a matrix, so we will keep the same notation, and if you think about your objects, then there should be little confusion. Here is the careful definition.
Notice that the kernel of $T$ is just the preimage of $\zerovector$, $\preimage{T}{\zerovector}$ (). Here is an example.
Example: Nontrivial kernel, Archetype O
is the linear transformation
To determine the elements of $\complex{3}$ in $\krn{T}$, find those vectors $\vect{u}$ such that $\lt{T}{\vect{u}}=\zerovector$, that is, \lt{T}{\vect{u}}&=\zerovector\\ \colvector{-u_1 + u_2 - 3 u_3\\ -u_1 + 2 u_2 - 4 u_3\\ u_1 + u_2 + u_3\\ 2 u_1 + 3 u_2 + u_3\\ u_1 + 2 u_3 } &= \colvector{0\\0\\0\\0\\0}
Vector equality () leads us to a homogeneous system of 5 equations in the variables $u_i$, -u_1 + u_2 - 3 u_3&=0\\ -u_1 + 2 u_2 - 4 u_3&=0\\ u_1 + u_2 + u_3&=0\\ 2 u_1 + 3 u_2 + u_3&=0\\ u_1 + 2 u_3&=0
Row-reducing the coefficient matrix gives \begin{bmatrix} \leading{1} & 0 & 2\\ 0 & \leading{1} & -1\\ 0 & 0 & 0\\ 0 & 0 & 0\\ 0 & 0 & 0 \end{bmatrix}
The kernel of $T$ is the set of solutions to this homogeneous system of equations, which by can be expressed as \krn{T}=\spn{}
We know that the span of a set of vectors is always a subspace (), so the kernel computed in is also a subspace. This is no accident, the kernel of a linear transformation is always a subspace.
Let us compute another kernel, now that we know in advance that it will be a subspace.
Our next theorem says that if a preimage is a nonempty set then we can construct it by picking any one element and adding on elements of the kernel.
This theorem, and its proof, should remind you very much of . Additionally, you might go back and review . Can you tell now which is the only preimage to be a subspace?
The next theorem is one we will cite frequently, as it characterizes injections by the size of the kernel.
Example: Not injective, Archetype O
In the kernel of was determined to be \spn{} a subspace of $\complex{3}$ with dimension 1. Since the kernel is not trivial, tells us that $T$ is not injective.
Example: Injective, Archetype P
In it was shown that the linear transformation in has a trivial kernel. So by , $T$ is injective.
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Injective Linear Transformations and Linear Independence
There is a connection between injective linear transformations and linearly independent sets that we will make precise in the next two theorems. However, more informally, we can get a feel for this connection when we think about how each property is defined. A set of vectors is linearly independent if the only relation of linear dependence is the trivial one. A linear transformation is injective if the only way two input vectors can produce the same output is in the trivial way, when both input vectors are equal.
Condensed — the full section is in Beezer, A First Course in Linear Algebra.
Injective Linear Transformations and Dimension
Example: Not injective by dimension, Archetype U
The linear transformation in is
Since $\dimension{M_{23}}=6>4=\dimension{\complex{4}}$, $T$ cannot be injective for then $T$ would violate .
Notice that the previous example made no use of the actual formula defining the function. Merely a comparison of the dimensions of the domain and codomain are enough to conclude that the linear transformation is not injective. and are two more examples of linear transformations that have big domains and small codomains, resulting in collisions of outputs and thus are non-injective linear transformations.
Composition of Injective Linear Transformations
In we saw how to combine linear transformations to build new linear transformations, specifically, how to build the composition of two linear transformations (). It will be useful later to know that the composition of injective linear transformations is again injective, so we prove that here.
Composition of Injective Linear TransformationsOne way to use Sage is to construct examples of theorems and verify the conclusions. Sometimes you will get this wrong: you might build an example that does not satisfy the hypotheses, or your example may not satisfy the conclusions. This may be because you are not using Sage properly, or because you do not understand a definition or a theorem, or in very limited cases you may have uncovered a bug in Sage (which is always the preferred explanation!). But in the process of trying to understand a discrepancy or unexpected result, you will learn much more, both about linear algebra and about Sage. And Sage is incredibly patient it will stay up with you all night to help you through a rough patch.
Let us illustrate the above in the context of . The hypotheses indicate we need two injective linear transformations. Where will get two such linear transformations? Well, the contrapositive of tells us that if the dimension of the domain exceeds the dimension of the codomain, we will never be injective. So we should at a minimum avoid this scenario. We can build two linear transformations from matrices created randomly, and just hope that they lead to injective linear transformations. Here is an example of how we create examples like this. The random matrix has single-digit entries, and almost always will lead to an injective linear transformation, though we cannot be absolutely certain. Evaluate this cell repeatedly, to see how rarely the result is not injective.
Our concrete example below was created this way, so here we go.
Symbols used here
A rectangular array of numbers; a linear map.
x belongs to A; every element of A is in B.
Inequalities that allow equality; < and > exclude it.
The two sides are different.
A quantity with magnitude and direction; a column of numbers.
Scaling factor of area/volume under A; zero means singular.
The matrix that undoes A; A with rows and columns swapped.
The factor by which an eigenvector is stretched: Av = λv.
Σ u_i v_i; the length of v, √(v·v).
Questions people ask
What does a determinant mean geometrically?
It is the factor by which the matrix scales area (2×2) or volume (3×3), with a negative sign if orientation flips. Zero means the matrix flattens space and cannot be undone.
What is an eigenvector?
A direction the matrix does not turn — it only stretches it by the eigenvalue. Along eigenvectors a complicated matrix acts like multiplication by a number.
Why is matrix multiplication not commutative?
Because a matrix is a transformation and AB means "do B, then A". Rotating then reflecting is not the same as reflecting then rotating.
ພະຍາຍາມເອງ
Parts of this page are adapted from Beezer, A First Course in Linear Algebra (GFDL 1.2). Condensed and re-explained here; errors are ours.
ເພີ່ມເຕີມໃນ Linear Algebra
DeterminantsMatrix inverseEigenvalues and eigenvectorsMatrix multiplicationRow reductionVector spaces, span and linear independenceOrthogonality, projections and least squaresDiagonalisation and matrix powersLinear transformations and change of basis