maths.free › Linear Algebra › Orthogonality, projections and least squares

Orthogonality, projections and least squares

Dot products, orthonormal bases, projection onto a subspace, fitting a line.

The projection of b onto the column space of A is the closest point; the least-squares solution solves AᵀA x = Aᵀ b. Gram-Schmidt turns any basis orthonormal. Picture it: dropping a perpendicular from a point onto a plane. Think it: least squares is regression; the normal equations are calculus's "set the gradient to zero" done with matrices.

Nhazi ahụ ejirila · inverse of [[2,1],[1,1]]

Inverse of [[2,1],[1,1]]

\left[\begin{matrix}2 & 1\\1 & 1\end{matrix}\right]

Nzọụkwụ site n'ụdị

  1. \det A = 1

    A matrix is invertible only when its determinant is non-zero.

  2. A^{-1} = \frac{1}{\det A}\begin{pmatrix} d & -b \\ -c & a \end{pmatrix} = \frac{1}{1}\left[\begin{matrix}1 & -1\\-1 & 2\end{matrix}\right]

    For 2×2: swap the diagonal, negate the off-diagonal, divide by the determinant.

  3. A^{-1} = \left[\begin{matrix}1 & -1\\-1 & 2\end{matrix}\right]

Gosi nzaghachi
A^{-1} = \left[\begin{matrix}1 & -1\\-1 & 2\end{matrix}\right]

Ugbu a ị Họrọ nsogbu, mọọbụ tinye mọọbụ depụta gị. Nzọụkwụ ọbụla, inyogo, azịza ahụ echekwara ruo mgbe ịjụla.

Kwụsị ọrụ gị

Akwụkwọ ndebanye n'efu na-egbakwunye ntọala n'ụdị ọmụmụ ihe ọbụla, ndepụta nke ihe ị ga-eme, nsogbu ị ga-ewepụ n'otu ebe, na onye nkụzi ị ga-ajụ banyere ihuakwụkwọ a. Akwụkwọ ndepụta ihe bụ nke ọbụla mepere maka onye ọbụla, ọbụla ma ọ bụ na ọ bụghị.

Akaụntụ Nbanye

Aịkọn ndị ahụ ejirila ebe a

Tinye ọbụla simbụl maka nkọwa zuru ezu, inyogo, na ihe ọbụla ọbụla na-egosi.

Olee otú: Orthogonality, projections and least squares

  1. A matrix is invertible only when its determinant is non-zero.
  2. For 2×2: swap the diagonal, negate the off-diagonal, divide by the determinant.

Ajụjụ ndị mmadụ jụrụ

What does a determinant mean geometrically?

It is the factor by which the matrix scales area (2×2) or volume (3×3), with a negative sign if orientation flips. Zero means the matrix flattens space and cannot be undone.

What is an eigenvector?

A direction the matrix does not turn: it only stretches it by the eigenvalue. Along eigenvectors a complicated matrix acts like multiplication by a number.

Why is matrix multiplication not commutative?

Because a matrix is a transformation and AB means "do B, then A". Rotating then reflecting is not the same as reflecting then rotating.

Oge Linear Algebra