The Inverse Matrix and Systems of Linear Equations

I. The Inverse Transformation: Turning Space “Back”

If the transformation MM stretches and rotates the plane, then the inverse transformation M−1M^{-1} turns it back to what it was:

M−1⋅M=I(the identity transformation, which does nothing)M^{-1} \cdot M = I \quad \text{(the identity transformation, which does nothing)} M⋅M−1=IM \cdot M^{-1} = I

Geometric intuition: MM is “deforming space”, and M−1M^{-1} is “restoring the deformation”. Deforming and then restoring = no change at all.

v ──M──► Mv ──M⁻¹──► v

The inverse matrix exists ⟺ det ≠ 0

  • det ≠ 0: the transformation squashes nothing, and everything can be perfectly restored → invertible
  • det = 0: space has been squashed flat, information has been lost, and it cannot be restored → not invertible (singular)

II. The Formula for the Inverse of a 2×2 Matrix

M=(abcd),M−1=1ad−bc(d−b−ca)M = \begin{pmatrix} a & b \\ c & d \end{pmatrix}, \quad M^{-1} = \frac{1}{ad - bc}\begin{pmatrix} d & -b \\ -c & a \end{pmatrix}

How to remember it:

  1. Swap the main diagonal: a↔da \leftrightarrow d
  2. Negate the off-diagonal: b,cb, c change sign
  3. Divide the whole thing by the determinant ad−bcad - bc
Example: M = [[2, 0], [0, 4]] (x stretched by 2, y stretched by 4)
det = 8
M⁻¹ = (1/8)[[4, 0], [0, 2]] = [[0.5, 0], [0, 0.25]]
Check: M·M⁻¹ = [[2×0.5, 0], [0, 4×0.25]] = [[1, 0], [0, 1]] = I ✓

Geometrically: the x direction is stretched by 2, so the inverse transformation compresses it back by half (×0.5); the same holds for the y direction.

III. Using the Inverse Matrix to Solve Systems of Linear Equations

A system of linear equations can be written in matrix form:

{ax+by=ecx+dy=f⟺(abcd)⏟M(xy)⏟x=(ef)⏟b\begin{cases} ax + by = e \\ cx + dy = f \end{cases} \quad \Longleftrightarrow \quad \underbrace{\begin{pmatrix} a & b \\ c & d \end{pmatrix}}_{M} \underbrace{\begin{pmatrix} x \\ y \end{pmatrix}}_{\mathbf{x}} = \underbrace{\begin{pmatrix} e \\ f \end{pmatrix}}_{\mathbf{b}}

that is, Mx=bM\mathbf{x} = \mathbf{b}.

Geometric view: the problem becomes — “which vector x\mathbf{x} lands on b\mathbf{b} after the transformation MM?”

Solving: multiply both sides on the left by M−1M^{-1}:

M−1Mx=M−1b  ⟹  x=M−1bM^{-1}M\mathbf{x} = M^{-1}\mathbf{b} \implies \mathbf{x} = M^{-1}\mathbf{b}
Example: 2x + 0y = 2     →  [[2,0],[0,4]]·(x,y) = (2, 8)
    0x + 4y = 8
M⁻¹ = [[0.5,0],[0,0.25]]
(x, y) = M⁻¹·(2, 8) = (0.5×2, 0.25×8) = (1, 2) ✓

Geometric meaning: solving an equation = “running the transformation backwards”. This is exactly the view that 3Blue1Brown emphasises: a system of linear equations is not a game of symbols, but “finding the vector that reaches the target after the transformation”.

IV. Understanding the Solvability of a System Geometrically

CaseGeometryThe solutions
det ≠ 0The transformation is full-dimensional, so b\mathbf{b} always has a unique preimagea unique solution
det = 0 and b\mathbf{b} is in the column spaceb\mathbf{b} lands on the squashed line, and several vectors map onto itinfinitely many solutions
det = 0 and b\mathbf{b} is not in the column spaceb\mathbf{b} is off the squashed lineno solution

”b\mathbf{b} is in the column space” — this concept is exactly the subject of the next section.

V. Other Properties of the Inverse Matrix

PropertyFormula
The inverse of a product(M1M2)−1=M2−1M1−1(M_1 M_2)^{-1} = M_2^{-1} M_1^{-1} (note the reversal of the order!)
The inverse of a transpose(MT)−1=(M−1)T(M^T)^{-1} = (M^{-1})^T
The inverse of an inverse(M−1)−1=M(M^{-1})^{-1} = M
The determinantdet⁡(M−1)=1/det⁡(M)\det(M^{-1}) = 1/\det(M)

Geometric understanding of (M1M2)−1=M2−1M1−1(M_1 M_2)^{-1} = M_2^{-1} M_1^{-1}: to undo “first M2M_2 and then M1M_1”, you have to undo M1M_1 first (with M1−1M_1^{-1}) and then undo M2M_2 (with M2−1M_2^{-1}) — so the order of the inverses is reversed.

Summary

Symbols Used in This Article

SymbolTypePronunciation/ExplanationMeaning in This Article
M−1M^{-1}Mathematical symbolM inverseThe inverse matrix: the reverse transformation that turns MM back to the original
IIMathematical symbolidentity matrixThe identity matrix (the identity transformation), satisfying M−1M=MM−1=IM^{-1}M = MM^{-1} = I
(abcd)\begin{pmatrix} a & b \\ c & d \end{pmatrix}Mathematical symbol2 by 2 matrixThe general form of a 2×2 matrix
ad−bcad - bcMathematical symbola d minus b cThe 2×2 determinant, the denominator in the inverse matrix formula
Mx=bM\mathbf{x} = \mathbf{b}Mathematical symbolM x equals bThe matrix form of a system of linear equations
x=M−1b\mathbf{x} = M^{-1}\mathbf{b}Mathematical symbolx equals M inverse bThe solution of the system obtained with the inverse matrix
(M1M2)−1(M_1 M_2)^{-1}Mathematical symbolinverse of M1 M2The inverse of a product, equal to M2−1M1−1M_2^{-1}M_1^{-1} (the order is reversed)

Found an issue with this content?

Tell us what could be improved.