Linear Combinations, the Span and Bases

I. Linear Combinations

A linear combination multiplies each of several vectors by a scalar and then adds them:

w=c1v1+c2v2+⋯+cnvn\mathbf{w} = c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n

where c1,c2,…,cnc_1, c_2, \dots, c_n are arbitrary scalars (real numbers).

Example: v₁ = (1, 0), v₂ = (0, 1)
w = 3·v₁ + 2·v₂ = (3, 0) + (0, 2) = (3, 2)

The key point: the scalars cic_i may be any real number (including negative numbers, zero and fractions).

II. The Span

Definition

The set formed by all linear combinations of a set of vectors is called their span:

span{v1,v2,…,vn}={c1v1+c2v2+⋯+cnvn∣ci∈R}\text{span}\{\mathbf{v}_1, \mathbf{v}_2, \dots, \mathbf{v}_n\} = \{c_1\mathbf{v}_1 + c_2\mathbf{v}_2 + \cdots + c_n\mathbf{v}_n \mid c_i \in \mathbb{R}\}

Intuition: let the scalars range over all real numbers, and you get every position the vectors can “reach”.

Interactive demo

What to observe:

  • two non-collinear vectors → they span the whole plane (every point can be reached)
  • two collinear vectors → they span only a straight line
  • a set containing the zero vector → the zero vector contributes nothing, and the span is still determined by the remaining vectors

III. Linear Dependence and Independence

Definitions

  • Linearly dependent: there exist scalars c1,…,cnc_1, \dots, c_n, not all zero, such that c1v1+⋯+cnvn=0c_1\mathbf{v}_1 + \cdots + c_n\mathbf{v}_n = \mathbf{0}.
  • Linearly independent: the linear combination is the zero vector only when c1=c2=⋯=cn=0c_1 = c_2 = \cdots = c_n = 0.

Intuition

SituationDependent / independentExplanation
Two collinear vectorsdependentone can be obtained from the other by scalar multiplication
Two non-collinear vectorsindependentneither is a multiple of the other
A set containing the zero vectoralways dependentthe zero vector is dependent with any vector
Three vectors in two dimensionsalways dependenttwo-dimensional space cannot hold 3 independent vectors
Examples:
v₁ = (1, 1), v₂ = (2, 2)  → dependent (v₂ = 2v₁)
v₁ = (1, 0), v₂ = (0, 1)  → independent

IV. Bases

Definition

A basis is a set of linearly independent vectors that spans the space, and it is “exactly enough” — no more, no less:

  1. Spanning: the linear combinations of the basis vectors can reach every point of the space
  2. Independence: there is no redundant vector (removing any one of them makes the span smaller)

The number of vectors in a basis = the dimension of the space.

The standard basis

The most commonly used basis of the two-dimensional plane is called the standard basis:

ı^=(1,0),ȷ^=(0,1)\hat{\imath} = (1, 0), \quad \hat{\jmath} = (0, 1)

Any vector can be written as a linear combination of them:

v=(3,2)=3ı^+2ȷ^\mathbf{v} = (3, 2) = 3\hat{\imath} + 2\hat{\jmath}

A basis is not unique

The same space has infinitely many bases. For example {(1,1),(1,−1)}\{(1,1), (1,-1)\} is also a basis of the two-dimensional plane — as long as the two vectors are not collinear.

Example: verifying that (1,1) and (1,-1) are a basis
any (x, y) = a(1,1) + b(1,-1)
Solving: a = (x+y)/2, b = (x-y)/2  ← there is a solution for any x, y
So they span the whole plane, and they are independent → they are a basis

V. An Intuitive Summary

ConceptIn one sentenceExample (two dimensions)
Linear combinationscale and then add3(1,0) + 2(0,1) = (3,2)
The spanevery position that can be reachedtwo non-collinear vectors → the whole plane
Linear dependencethere is redundancy (one can be expressed using the others)(1,1) and (2,2)
Linear independenceno redundancy(1,0) and (0,1)
A basisspanning and independent1

Summary

Symbols Used in This Article

SymbolTypePronunciation/ExplanationMeaning in This Article
v1,…,vn\mathbf{v}_1, \dots, \mathbf{v}_nMathematical symbolv one through v nThe set of vectors taking part in the linear combination
c1,…,cnc_1, \dots, c_nMathematical symbolc one through c nArbitrary scalars (real numbers), which may be negative, zero or fractional
w=c1v1+⋯+cnvn\mathbf{w} = c_1\mathbf{v}_1 + \cdots + c_n\mathbf{v}_nMathematical symbollinear combination of v’sA linear combination: scaling each vector and then adding
span⁡{v1,…,vn}\operatorname{span}\{\mathbf{v}_1, \dots, \mathbf{v}_n\}Mathematical symbolspan of v’sThe set formed by all linear combinations of the vectors (the positions that can be reached)
R\mathbb{R}Mathematical symbolthe realsThe field of real numbers, the range of the scalars cic_i
0\mathbf{0}Mathematical symbolzero vectorThe zero vector; the linear combination equals 0\mathbf{0} in the test for linear dependence
ı^,ȷ^\hat{\imath}, \hat{\jmath}Mathematical symboli hat, j hatThe standard basis: (1,0)(1,0) and (0,1)(0,1)

Found an issue with this content?

Tell us what could be improved.