2.2 Span, Linear Independence, and Bases 15
R
3
, then SpanS is just the set of all vectors of the form (c
1
,c
2
, 0) with c
1
,c
2
∈R.If
S has infinitely many elements then the span of S is again all the linear combinations
of vectors in S, though in this case the linear combinations can have an arbitrarily
large (but finite) number of terms.
6
Next we need the notion of linear dependence: a (not necessarily finite) set of vec-
tors S is said to be linearly dependent if there exists distinct vectors v
1
,v
2
,...,v
m
in S and scalars c
1
,c
2
,...,c
m
, not all of which are 0, such that
c
1
v
1
+c
2
v
2
+···+c
m
v
m
=0. (2.7)
What this definition really means is that at least one vector in S can be written as a
linear combination of the others, and in that sense is dependent (you should take a
second to convince yourself of this). If S is not linearly dependent then we say it is
linearly independent, and in this case no vector in S can be written as a linear com-
bination of any others. For instance, the set S ={(1, 0, 0), (0, 1, 0), (1, 1, 0)}⊂R
3
is linearly dependent whereas the set S
={(1, 0, 0), (0, 1, 0), (0, 1, 1)} is linearly
independent, as you can check.
With these definitions in place we can now define a basis for a vector space V
as an ordered linearly independent set B ⊂ V whose span is all of V . This means,
roughly speaking, that a basis has enough vectors to make all the others, but no
more than that. When we say that B ={v
1
,...,v
k
} is an ordered set we mean that
the order of the v
i
is part of the definition of B, so another basis with the same
vectors but a different order is considered inequivalent. The reasons for this will
become clear as we progress.
One can show
7
that all finite bases must have the same number of elements, so
we define the dimension of a vector space V , denoted dim V , to be the number of
elements of any finite basis. If no finite basis exists, then we say that V is infinite-
dimensional.
Also, we should mention that basis vectors are often denoted e
i
rather than v
i
,
and we will use this notation from now on.
Exercise 2.3 Given a vector v and a finite basis B ={e
i
}
i=1,...,n
, show that the expression
of v as a linear combination of the e
i
is unique.
Example 2.7 R
n
and C
n
R
n
has the following natural basis, also known as the standard basis:
(1, 0,...,0), (0, 1,...,0),...,(0,...,1)
.
You should check that this is indeed a basis, and thus that the dimension of R
n
is, unsurprisingly, n. The same set serves as a basis for C
n
, where of course
6
We do not generally consider infinite linear combinations like
∞
i=1
c
i
v
i
= lim
N→∞
N
i=1
c
i
v
i
because in that case we would need to consider whether the limit exists, i.e. whether the sum
converges in some sense. More on this later.
7
See Hoffman and Kunze [10].